2023-02-11 00:53:28,320 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-11 00:53:28,586 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1 2023-02-11 00:53:28,598 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-11 00:53:28,599 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b, deleteOnExit=true 2023-02-11 00:53:28,599 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 00:53:28,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/test.cache.data in system properties and HBase conf 2023-02-11 00:53:28,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 00:53:28,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/hadoop.log.dir in system properties and HBase conf 2023-02-11 00:53:28,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 00:53:28,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 00:53:28,601 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 00:53:28,709 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 00:53:29,123 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 00:53:29,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 00:53:29,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 00:53:29,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 00:53:29,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 00:53:29,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 00:53:29,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 00:53:29,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 00:53:29,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 00:53:29,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 00:53:29,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/nfs.dump.dir in system properties and HBase conf 2023-02-11 00:53:29,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/java.io.tmpdir in system properties and HBase conf 2023-02-11 00:53:29,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 00:53:29,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 00:53:29,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 00:53:29,677 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 00:53:29,681 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 00:53:29,960 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 00:53:30,147 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 00:53:30,162 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 00:53:30,204 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 00:53:30,239 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/java.io.tmpdir/Jetty_localhost_37239_hdfs____a9c8gu/webapp 2023-02-11 00:53:30,389 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37239 2023-02-11 00:53:30,434 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 00:53:30,434 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 00:53:30,878 WARN [Listener at localhost/45853] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 00:53:30,999 WARN [Listener at localhost/45853] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 00:53:31,018 WARN [Listener at localhost/45853] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 00:53:31,025 INFO [Listener at localhost/45853] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 00:53:31,030 INFO [Listener at localhost/45853] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/java.io.tmpdir/Jetty_localhost_41071_datanode____ccipqs/webapp 2023-02-11 00:53:31,125 INFO [Listener at localhost/45853] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41071 2023-02-11 00:53:31,427 WARN [Listener at localhost/36341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 00:53:31,839 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb131602c43eca238: Processing first storage report for DS-e6adf760-64e4-4943-85c5-42fd42cb2545 from datanode f32ddb08-ad27-4673-b5ea-ad7978885454 2023-02-11 00:53:31,841 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb131602c43eca238: from storage DS-e6adf760-64e4-4943-85c5-42fd42cb2545 node DatanodeRegistration(127.0.0.1:46469, datanodeUuid=f32ddb08-ad27-4673-b5ea-ad7978885454, infoPort=33447, infoSecurePort=0, ipcPort=36341, storageInfo=lv=-57;cid=testClusterID;nsid=695924512;c=1676076809755), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-11 00:53:31,841 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb131602c43eca238: Processing first storage report for DS-76ffa664-13f0-4e4f-aea4-7bb81ce038c2 from datanode f32ddb08-ad27-4673-b5ea-ad7978885454 2023-02-11 00:53:31,841 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb131602c43eca238: from storage DS-76ffa664-13f0-4e4f-aea4-7bb81ce038c2 node DatanodeRegistration(127.0.0.1:46469, datanodeUuid=f32ddb08-ad27-4673-b5ea-ad7978885454, infoPort=33447, infoSecurePort=0, ipcPort=36341, storageInfo=lv=-57;cid=testClusterID;nsid=695924512;c=1676076809755), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 00:53:31,911 DEBUG [Listener at localhost/36341] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1 2023-02-11 00:53:31,983 INFO [Listener at localhost/36341] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/zookeeper_0, clientPort=63942, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 00:53:31,997 INFO [Listener at localhost/36341] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63942 2023-02-11 00:53:32,007 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:32,009 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:32,655 INFO [Listener at localhost/36341] util.FSUtils(479): Created version file at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059 with version=8 2023-02-11 00:53:32,656 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/hbase-staging 2023-02-11 00:53:32,951 INFO [Listener at localhost/36341] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 00:53:33,391 INFO [Listener at localhost/36341] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 00:53:33,422 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,423 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,423 INFO [Listener at localhost/36341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 00:53:33,423 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,423 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 00:53:33,563 INFO [Listener at localhost/36341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 00:53:33,639 DEBUG [Listener at localhost/36341] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 00:53:33,732 INFO [Listener at localhost/36341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33799 2023-02-11 00:53:33,742 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:33,744 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:33,764 INFO [Listener at localhost/36341] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33799 connecting to ZooKeeper ensemble=127.0.0.1:63942 2023-02-11 00:53:33,803 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:337990x0, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 00:53:33,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33799-0x10040de70860000 connected 2023-02-11 00:53:33,832 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 00:53:33,833 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 00:53:33,836 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 00:53:33,843 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33799 2023-02-11 00:53:33,844 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33799 2023-02-11 00:53:33,844 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33799 2023-02-11 00:53:33,844 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33799 2023-02-11 00:53:33,845 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33799 2023-02-11 00:53:33,851 INFO [Listener at localhost/36341] master.HMaster(439): hbase.rootdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059, hbase.cluster.distributed=false 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 00:53:33,916 INFO [Listener at localhost/36341] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 00:53:33,921 INFO [Listener at localhost/36341] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 00:53:33,924 INFO [Listener at localhost/36341] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43697 2023-02-11 00:53:33,926 INFO [Listener at localhost/36341] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 00:53:33,931 DEBUG [Listener at localhost/36341] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 00:53:33,932 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:33,935 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:33,936 INFO [Listener at localhost/36341] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43697 connecting to ZooKeeper ensemble=127.0.0.1:63942 2023-02-11 00:53:33,940 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:436970x0, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 00:53:33,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43697-0x10040de70860001 connected 2023-02-11 00:53:33,941 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 00:53:33,942 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 00:53:33,943 DEBUG [Listener at localhost/36341] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 00:53:33,943 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43697 2023-02-11 00:53:33,944 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43697 2023-02-11 00:53:33,944 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43697 2023-02-11 00:53:33,945 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43697 2023-02-11 00:53:33,945 DEBUG [Listener at localhost/36341] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43697 2023-02-11 00:53:33,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:33,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 00:53:33,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:33,975 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 00:53:33,975 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 00:53:33,975 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:33,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 00:53:33,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33799,1676076812795 from backup master directory 2023-02-11 00:53:33,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 00:53:33,980 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:33,981 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 00:53:33,981 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 00:53:33,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:33,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 00:53:33,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 00:53:34,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/hbase.id with ID: 0d8092cf-7f27-4c10-9595-059268cb858a 2023-02-11 00:53:34,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:34,523 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:34,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x32ba0f0f to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:34,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66511b3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:35,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 00:53:35,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 00:53:35,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 00:53:35,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 00:53:35,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 00:53:35,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 00:53:35,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 00:53:35,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store-tmp 2023-02-11 00:53:35,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:35,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 00:53:35,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:53:35,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:53:35,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 00:53:35,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:53:35,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:53:35,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676076815101Disabling compacts and flushes for region at 1676076815101Disabling writes for close at 1676076815102 (+1 ms)Writing region close event to WAL at 1676076815102Closed at 1676076815102 2023-02-11 00:53:35,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/WALs/jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:35,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33799%2C1676076812795, suffix=, logDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/WALs/jenkins-hbase4.apache.org,33799,1676076812795, archiveDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/oldWALs, maxLogs=10 2023-02-11 00:53:35,176 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK] 2023-02-11 00:53:35,183 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 00:53:35,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/WALs/jenkins-hbase4.apache.org,33799,1676076812795/jenkins-hbase4.apache.org%2C33799%2C1676076812795.1676076815135 2023-02-11 00:53:35,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK]] 2023-02-11 00:53:35,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:35,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:35,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,302 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,308 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 00:53:35,331 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 00:53:35,345 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:35,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 00:53:35,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:53:35,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59126330, jitterRate=-0.1189490258693695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:53:35,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676076815271Initializing all the Stores at 1676076815273 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676076815274 (+1 ms)Cleaning up temporary data from old regions at 1676076815358 (+84 ms)Cleaning up detritus from prior splits at 1676076815359 (+1 ms)Region opened successfully at 1676076815372 (+13 ms) 2023-02-11 00:53:35,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 00:53:35,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 00:53:35,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 00:53:35,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 00:53:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-11 00:53:35,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-02-11 00:53:35,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 00:53:35,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 00:53:35,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 00:53:35,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 00:53:35,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 00:53:35,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 00:53:35,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 00:53:35,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 00:53:35,501 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:35,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 00:53:35,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 00:53:35,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 00:53:35,518 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 00:53:35,519 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 00:53:35,519 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:35,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33799,1676076812795, sessionid=0x10040de70860000, setting cluster-up flag (Was=false) 2023-02-11 00:53:35,533 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:35,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 00:53:35,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:35,547 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:35,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 00:53:35,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:35,556 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp 2023-02-11 00:53:35,649 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(952): ClusterId : 0d8092cf-7f27-4c10-9595-059268cb858a 2023-02-11 00:53:35,655 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 00:53:35,662 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 00:53:35,662 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 00:53:35,665 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 00:53:35,667 DEBUG [RS:0;jenkins-hbase4:43697] zookeeper.ReadOnlyZKClient(139): Connect 0x78bad09c to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:35,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 00:53:35,675 DEBUG [RS:0;jenkins-hbase4:43697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@767d21fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:35,676 DEBUG [RS:0;jenkins-hbase4:43697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7242bbec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 00:53:35,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676076845685 2023-02-11 00:53:35,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 00:53:35,689 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 00:53:35,689 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 00:53:35,695 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 00:53:35,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 00:53:35,703 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43697 2023-02-11 00:53:35,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 00:53:35,710 INFO [RS:0;jenkins-hbase4:43697] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 00:53:35,710 INFO [RS:0;jenkins-hbase4:43697] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 00:53:35,710 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 00:53:35,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 00:53:35,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 00:53:35,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 00:53:35,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 00:53:35,713 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33799,1676076812795 with isa=jenkins-hbase4.apache.org/172.31.14.131:43697, startcode=1676076813915 2023-02-11 00:53:35,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 00:53:35,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 00:53:35,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 00:53:35,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 00:53:35,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676076815719,5,FailOnTimeoutGroup] 2023-02-11 00:53:35,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676076815719,5,FailOnTimeoutGroup] 2023-02-11 00:53:35,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 00:53:35,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,733 DEBUG [RS:0;jenkins-hbase4:43697] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 00:53:35,782 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60315, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 00:53:35,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,807 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059 2023-02-11 00:53:35,808 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45853 2023-02-11 00:53:35,808 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 00:53:35,813 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 00:53:35,813 DEBUG [RS:0;jenkins-hbase4:43697] zookeeper.ZKUtil(162): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,813 WARN [RS:0;jenkins-hbase4:43697] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 00:53:35,814 INFO [RS:0;jenkins-hbase4:43697] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 00:53:35,814 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/WALs/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,815 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43697,1676076813915] 2023-02-11 00:53:35,823 DEBUG [RS:0;jenkins-hbase4:43697] zookeeper.ZKUtil(162): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,832 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 00:53:35,841 INFO [RS:0;jenkins-hbase4:43697] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 00:53:35,859 INFO [RS:0;jenkins-hbase4:43697] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 00:53:35,863 INFO [RS:0;jenkins-hbase4:43697] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:53:35,863 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,864 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 00:53:35,871 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,871 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,871 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,872 DEBUG [RS:0;jenkins-hbase4:43697] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 00:53:35,873 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,873 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,873 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,889 INFO [RS:0;jenkins-hbase4:43697] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 00:53:35,892 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43697,1676076813915-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:35,908 INFO [RS:0;jenkins-hbase4:43697] regionserver.Replication(203): jenkins-hbase4.apache.org,43697,1676076813915 started 2023-02-11 00:53:35,908 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43697,1676076813915, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43697, sessionid=0x10040de70860001 2023-02-11 00:53:35,909 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 00:53:35,909 DEBUG [RS:0;jenkins-hbase4:43697] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,909 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43697,1676076813915' 2023-02-11 00:53:35,909 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:35,910 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43697,1676076813915' 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 00:53:35,911 DEBUG [RS:0;jenkins-hbase4:43697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 00:53:35,912 DEBUG [RS:0;jenkins-hbase4:43697] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 00:53:35,912 INFO [RS:0;jenkins-hbase4:43697] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 00:53:35,912 INFO [RS:0;jenkins-hbase4:43697] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 00:53:36,023 INFO [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43697%2C1676076813915, suffix=, logDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/WALs/jenkins-hbase4.apache.org,43697,1676076813915, archiveDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/oldWALs, maxLogs=32 2023-02-11 00:53:36,041 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK] 2023-02-11 00:53:36,044 INFO [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/WALs/jenkins-hbase4.apache.org,43697,1676076813915/jenkins-hbase4.apache.org%2C43697%2C1676076813915.1676076816025 2023-02-11 00:53:36,045 DEBUG [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK]] 2023-02-11 00:53:36,134 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:36,135 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:36,135 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059 2023-02-11 00:53:36,548 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:36,551 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 00:53:36,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/info 2023-02-11 00:53:36,554 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 00:53:36,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:36,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 00:53:36,558 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/rep_barrier 2023-02-11 00:53:36,559 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 00:53:36,560 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:36,560 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 00:53:36,562 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/table 2023-02-11 00:53:36,562 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 00:53:36,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:36,565 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740 2023-02-11 00:53:36,565 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740 2023-02-11 00:53:36,569 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 00:53:36,571 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 00:53:36,574 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:53:36,575 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64156739, jitterRate=-0.04399009048938751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 00:53:36,575 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676076816548Initializing all the Stores at 1676076816550 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676076816550Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676076816550Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676076816550Cleaning up temporary data from old regions at 1676076816567 (+17 ms)Cleaning up detritus from prior splits at 1676076816568 (+1 ms)Region opened successfully at 1676076816575 (+7 ms) 2023-02-11 00:53:36,576 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 00:53:36,576 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 00:53:36,576 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 00:53:36,576 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 00:53:36,576 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 00:53:36,577 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 00:53:36,577 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676076816576Disabling compacts and flushes for region at 1676076816576Disabling writes for close at 1676076816576Writing region close event to WAL at 1676076816577 (+1 ms)Closed at 1676076816577 2023-02-11 00:53:36,582 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 00:53:36,582 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 00:53:36,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 00:53:36,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 00:53:36,603 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 00:53:36,755 DEBUG [jenkins-hbase4:33799] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-11 00:53:36,757 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43697,1676076813915, state=OPENING 2023-02-11 00:53:36,765 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 00:53:36,767 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:36,767 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 00:53:36,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:36,952 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:36,954 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 00:53:36,957 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 00:53:36,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 00:53:36,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 00:53:36,971 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43697%2C1676076813915.meta, suffix=.meta, logDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/WALs/jenkins-hbase4.apache.org,43697,1676076813915, archiveDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/oldWALs, maxLogs=32 2023-02-11 00:53:36,988 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK] 2023-02-11 00:53:36,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/WALs/jenkins-hbase4.apache.org,43697,1676076813915/jenkins-hbase4.apache.org%2C43697%2C1676076813915.meta.1676076816972.meta 2023-02-11 00:53:36,993 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46469,DS-e6adf760-64e4-4943-85c5-42fd42cb2545,DISK]] 2023-02-11 00:53:36,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:36,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 00:53:37,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 00:53:37,016 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 00:53:37,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 00:53:37,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:37,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 00:53:37,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 00:53:37,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 00:53:37,026 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/info 2023-02-11 00:53:37,026 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/info 2023-02-11 00:53:37,026 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 00:53:37,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:37,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 00:53:37,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/rep_barrier 2023-02-11 00:53:37,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/rep_barrier 2023-02-11 00:53:37,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 00:53:37,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:37,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 00:53:37,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/table 2023-02-11 00:53:37,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/table 2023-02-11 00:53:37,032 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 00:53:37,033 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:37,034 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740 2023-02-11 00:53:37,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740 2023-02-11 00:53:37,041 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 00:53:37,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 00:53:37,044 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69215370, jitterRate=0.03138938546180725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 00:53:37,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676076817022Writing region info on filesystem at 1676076817022Initializing all the Stores at 1676076817023 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676076817023Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676076817024 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676076817024Cleaning up temporary data from old regions at 1676076817039 (+15 ms)Cleaning up detritus from prior splits at 1676076817039Running coprocessor post-open hooks at 1676076817044 (+5 ms)Region opened successfully at 1676076817044 2023-02-11 00:53:37,053 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676076816944 2023-02-11 00:53:37,069 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 00:53:37,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 00:53:37,071 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43697,1676076813915, state=OPEN 2023-02-11 00:53:37,074 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 00:53:37,074 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 00:53:37,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 00:53:37,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43697,1676076813915 in 305 msec 2023-02-11 00:53:37,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 00:53:37,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 489 msec 2023-02-11 00:53:37,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4870 sec 2023-02-11 00:53:37,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676076813971, completionTime=-1 2023-02-11 00:53:37,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-11 00:53:37,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 00:53:37,149 DEBUG [hconnection-0x7afe0d80-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:53:37,153 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:53:37,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-11 00:53:37,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676076877169 2023-02-11 00:53:37,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676076937169 2023-02-11 00:53:37,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-11 00:53:37,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1676076812795-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:37,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1676076812795-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:37,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1676076812795-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:37,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33799, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:37,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 00:53:37,200 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 00:53:37,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 00:53:37,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 00:53:37,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 00:53:37,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:53:37,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:53:37,242 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/hbase/namespace/8345c4509858289d889b35025a217950 2023-02-11 00:53:37,244 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/hbase/namespace/8345c4509858289d889b35025a217950 empty. 2023-02-11 00:53:37,245 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/hbase/namespace/8345c4509858289d889b35025a217950 2023-02-11 00:53:37,245 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 00:53:37,264 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:37,266 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8345c4509858289d889b35025a217950, NAME => 'hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:53:37,277 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:37,277 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8345c4509858289d889b35025a217950, disabling compactions & flushes 2023-02-11 00:53:37,277 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,278 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,278 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. after waiting 0 ms 2023-02-11 00:53:37,278 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,278 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,278 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8345c4509858289d889b35025a217950: Waiting for close lock at 1676076817277Disabling compacts and flushes for region at 1676076817277Disabling writes for close at 1676076817278 (+1 ms)Writing region close event to WAL at 1676076817278Closed at 1676076817278 2023-02-11 00:53:37,282 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:53:37,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676076817285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076817285"}]},"ts":"1676076817285"} 2023-02-11 00:53:37,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:53:37,328 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:53:37,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076817328"}]},"ts":"1676076817328"} 2023-02-11 00:53:37,337 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 00:53:37,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8345c4509858289d889b35025a217950, ASSIGN}] 2023-02-11 00:53:37,350 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8345c4509858289d889b35025a217950, ASSIGN 2023-02-11 00:53:37,351 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8345c4509858289d889b35025a217950, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:53:37,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8345c4509858289d889b35025a217950, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:37,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676076817502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076817502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076817502"}]},"ts":"1676076817502"} 2023-02-11 00:53:37,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8345c4509858289d889b35025a217950, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:37,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8345c4509858289d889b35025a217950, NAME => 'hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:37,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8345c4509858289d889b35025a217950 2023-02-11 00:53:37,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:37,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8345c4509858289d889b35025a217950 2023-02-11 00:53:37,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8345c4509858289d889b35025a217950 2023-02-11 00:53:37,671 INFO [StoreOpener-8345c4509858289d889b35025a217950-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8345c4509858289d889b35025a217950 2023-02-11 00:53:37,673 DEBUG [StoreOpener-8345c4509858289d889b35025a217950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/info 2023-02-11 00:53:37,673 DEBUG [StoreOpener-8345c4509858289d889b35025a217950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/info 2023-02-11 00:53:37,674 INFO [StoreOpener-8345c4509858289d889b35025a217950-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8345c4509858289d889b35025a217950 columnFamilyName info 2023-02-11 00:53:37,675 INFO [StoreOpener-8345c4509858289d889b35025a217950-1] regionserver.HStore(310): Store=8345c4509858289d889b35025a217950/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:37,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950 2023-02-11 00:53:37,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950 2023-02-11 00:53:37,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8345c4509858289d889b35025a217950 2023-02-11 00:53:37,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:53:37,686 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8345c4509858289d889b35025a217950; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75341585, jitterRate=0.12267710268497467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:53:37,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8345c4509858289d889b35025a217950: Running coprocessor pre-open hook at 1676076817669Writing region info on filesystem at 1676076817669Initializing all the Stores at 1676076817671 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676076817671Cleaning up temporary data from old regions at 1676076817678 (+7 ms)Cleaning up detritus from prior splits at 1676076817678Running coprocessor post-open hooks at 1676076817686 (+8 ms)Region opened successfully at 1676076817686 2023-02-11 00:53:37,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950., pid=6, masterSystemTime=1676076817661 2023-02-11 00:53:37,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:53:37,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8345c4509858289d889b35025a217950, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:37,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676076817692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076817692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076817692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076817692"}]},"ts":"1676076817692"} 2023-02-11 00:53:37,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 00:53:37,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8345c4509858289d889b35025a217950, server=jenkins-hbase4.apache.org,43697,1676076813915 in 190 msec 2023-02-11 00:53:37,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 00:53:37,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8345c4509858289d889b35025a217950, ASSIGN in 354 msec 2023-02-11 00:53:37,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:53:37,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076817706"}]},"ts":"1676076817706"} 2023-02-11 00:53:37,708 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 00:53:37,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:53:37,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 501 msec 2023-02-11 00:53:37,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 00:53:37,722 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 00:53:37,722 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:53:37,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 00:53:37,770 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 00:53:37,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-02-11 00:53:37,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 00:53:37,798 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 00:53:37,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-11 00:53:37,815 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 00:53:37,818 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 00:53:37,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.837sec 2023-02-11 00:53:37,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 00:53:37,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 00:53:37,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 00:53:37,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1676076812795-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 00:53:37,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1676076812795-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 00:53:37,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 00:53:37,855 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(139): Connect 0x6decc8b7 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:37,860 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@515b7931, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:37,873 DEBUG [hconnection-0x1b386a6b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:53:37,884 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:53:37,893 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:53:37,894 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(139): Connect 0x06140021 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:37,898 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2f2d5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:37,899 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:53:37,919 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=168, AvailableMemoryMB=4158 2023-02-11 00:53:37,930 DEBUG [Listener at localhost/36341] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:53:37,933 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:53:37,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:53:37,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:37,949 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:53:37,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:53:37,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-11 00:53:37,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:37,955 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 empty. 2023-02-11 00:53:37,956 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:37,957 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-11 00:53:37,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 00:53:38,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 00:53:38,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 00:53:38,373 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:38,376 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4700892eb348df5c2d48ad6d6e217a96, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:53:38,387 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:38,388 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 4700892eb348df5c2d48ad6d6e217a96, disabling compactions & flushes 2023-02-11 00:53:38,388 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,388 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,388 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. after waiting 0 ms 2023-02-11 00:53:38,388 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,388 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,388 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 4700892eb348df5c2d48ad6d6e217a96: Waiting for close lock at 1676076818388Disabling compacts and flushes for region at 1676076818388Disabling writes for close at 1676076818388Writing region close event to WAL at 1676076818388Closed at 1676076818388 2023-02-11 00:53:38,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:53:38,394 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076818393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076818393"}]},"ts":"1676076818393"} 2023-02-11 00:53:38,396 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:53:38,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:53:38,398 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076818398"}]},"ts":"1676076818398"} 2023-02-11 00:53:38,400 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-11 00:53:38,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, ASSIGN}] 2023-02-11 00:53:38,405 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, ASSIGN 2023-02-11 00:53:38,407 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:53:38,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:38,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076818558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076818558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076818558"}]},"ts":"1676076818558"} 2023-02-11 00:53:38,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:38,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 00:53:38,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4700892eb348df5c2d48ad6d6e217a96, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:38,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,725 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,727 DEBUG [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:38,727 DEBUG [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:38,730 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4700892eb348df5c2d48ad6d6e217a96 columnFamilyName family1 2023-02-11 00:53:38,732 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] regionserver.HStore(310): Store=4700892eb348df5c2d48ad6d6e217a96/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:38,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:38,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:53:38,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4700892eb348df5c2d48ad6d6e217a96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71725346, jitterRate=0.06879094243049622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:53:38,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4700892eb348df5c2d48ad6d6e217a96: Running coprocessor pre-open hook at 1676076818722Writing region info on filesystem at 1676076818722Initializing all the Stores at 1676076818723 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076818723Cleaning up temporary data from old regions at 1676076818736 (+13 ms)Cleaning up detritus from prior splits at 1676076818737 (+1 ms)Running coprocessor post-open hooks at 1676076818745 (+8 ms)Region opened successfully at 1676076818745 2023-02-11 00:53:38,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., pid=11, masterSystemTime=1676076818715 2023-02-11 00:53:38,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:38,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:38,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076818750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076818750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076818750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076818750"}]},"ts":"1676076818750"} 2023-02-11 00:53:38,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 00:53:38,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915 in 192 msec 2023-02-11 00:53:38,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-11 00:53:38,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, ASSIGN in 354 msec 2023-02-11 00:53:38,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:53:38,763 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076818763"}]},"ts":"1676076818763"} 2023-02-11 00:53:38,765 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-11 00:53:38,769 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:53:38,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 824 msec 2023-02-11 00:53:39,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 00:53:39,073 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-11 00:53:39,097 DEBUG [hconnection-0x3951a133-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:53:39,101 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:53:39,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:39,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,272 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:39,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:39,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:39,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:39,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,275 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:39,275 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:39,276 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,276 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:39,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,281 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:39,281 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:39,282 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:39,283 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:39,283 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:39,283 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:39,284 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:39,285 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:53:39,846 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308e1ed1ce5d1945b5be38e608b32623bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511308e1ed1ce5d1945b5be38e608b32623bc 2023-02-11 00:53:39,862 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0659ef7ddcac42089c7e50794808ec0d 2023-02-11 00:53:39,873 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0659ef7ddcac42089c7e50794808ec0d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d 2023-02-11 00:53:39,888 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-11 00:53:39,891 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 606ms, sequenceid=5, compaction requested=false 2023-02-11 00:53:39,893 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:39,895 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:39,895 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:39,896 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:39,899 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:39,900 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,900 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:39,903 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5188125[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:39,903 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:39,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:39,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,908 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:39,908 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:39,908 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:39,913 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:39,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:39,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:39,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:39,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,913 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:39,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:39,916 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,918 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,926 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:39,927 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:39,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:39,927 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:39,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:39,928 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,929 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:39,930 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:39,930 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:40,030 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:40,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:40,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:40,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:40,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,049 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:40,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:40,050 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:40,050 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:40,050 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,050 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,052 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:40,052 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:40,053 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,053 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,054 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,054 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:40,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:40,055 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:40,061 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:40,061 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:40,061 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:40,061 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:40,061 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:53:40,497 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c33f5ec5bd474840aea8a67bbe4bc64c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c33f5ec5bd474840aea8a67bbe4bc64c 2023-02-11 00:53:40,509 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/98bde5ed47e841aa8d288c0314959f20 2023-02-11 00:53:40,566 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/98bde5ed47e841aa8d288c0314959f20 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20 2023-02-11 00:53:40,574 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:53:40,575 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 514ms, sequenceid=9, compaction requested=false 2023-02-11 00:53:40,576 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:40,576 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:40,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,580 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54818ba0[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:40,582 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:40,582 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,583 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,584 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:40,584 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:40,584 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:40,584 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,584 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:40,586 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:40,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:40,590 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:40,590 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:40,590 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:40,590 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,590 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:40,596 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,596 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:40,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,596 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:40,597 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:40,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:40,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:40,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,599 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:40,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:40,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,603 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:40,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:40,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:40,603 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,604 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,604 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,604 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:40,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:40,604 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:40,604 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:40,704 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:40,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:40,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:40,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,716 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:40,717 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:40,717 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:40,717 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:40,718 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,718 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,719 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:40,719 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:40,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:40,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:40,724 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:40,724 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:40,724 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:40,724 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:40,724 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:41,149 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201060cb252840f4252b56755004f89a61a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201060cb252840f4252b56755004f89a61a 2023-02-11 00:53:41,564 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/acacb6c000bb489fa5ecece9f7d742ba 2023-02-11 00:53:41,574 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/acacb6c000bb489fa5ecece9f7d742ba as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba 2023-02-11 00:53:41,584 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 00:53:41,585 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 861ms, sequenceid=13, compaction requested=true 2023-02-11 00:53:41,585 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:41,585 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:41,588 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,588 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:41,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:41,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:41,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37ecbb0[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:41,591 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:41,592 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,599 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,599 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:41,599 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:41,599 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:41,599 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,600 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:41,602 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:41,602 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:41,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:41,606 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:41,606 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:41,606 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:41,606 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,606 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:41,608 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,608 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,608 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:41,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:41,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:41,609 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:41,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,619 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,624 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,624 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:41,624 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:41,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:41,624 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,625 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:41,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:41,625 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:41,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:41,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 00:53:41,625 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,626 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,626 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,626 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,627 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:41,627 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:41,727 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:41,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:41,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:41,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:41,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,744 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:41,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:41,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:41,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:41,745 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,745 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,748 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:41,748 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:41,749 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,749 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:41,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,750 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,750 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:41,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:41,750 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:41,752 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:41,752 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:41,752 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:41,752 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:41,752 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:41,837 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 00:53:41,838 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 00:53:42,194 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120589c319334a5146738150f152ee1c5054 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120589c319334a5146738150f152ee1c5054 2023-02-11 00:53:42,207 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/1a850c37bde242d4afede592e95b73eb 2023-02-11 00:53:42,216 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/1a850c37bde242d4afede592e95b73eb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb 2023-02-11 00:53:42,224 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 00:53:42,225 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 473ms, sequenceid=17, compaction requested=true 2023-02-11 00:53:42,225 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:42,225 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:42,228 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,228 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:42,228 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,228 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:42,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:42,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aff0c8c[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:42,231 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:42,231 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,232 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,232 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:42,232 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:42,232 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:42,232 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,233 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:42,234 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:42,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:42,238 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:42,238 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:42,238 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:42,238 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,238 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:42,241 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,241 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:42,241 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,242 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,244 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,248 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,248 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,249 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:42,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:42,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:42,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 00:53:42,249 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:42,250 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:42,250 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:42,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:42,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:42,350 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:42,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:42,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,362 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:42,362 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:42,362 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:42,362 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:42,363 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,363 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,406 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:42,406 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:42,407 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,407 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:42,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:42,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:42,408 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:42,408 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:42,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:42,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:42,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:42,409 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:42,409 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:42,409 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:42,544 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:53:42,833 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228720efa37276f4eb2afb22591a737fb41 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228720efa37276f4eb2afb22591a737fb41 2023-02-11 00:53:42,946 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 00:53:42,946 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 00:53:43,244 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0f5f76c11881495caeee2f469c03257b 2023-02-11 00:53:43,253 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0f5f76c11881495caeee2f469c03257b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b 2023-02-11 00:53:43,262 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 00:53:43,263 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 854ms, sequenceid=21, compaction requested=true 2023-02-11 00:53:43,264 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:43,264 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:43,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,269 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,270 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,270 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:43,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b2fad5f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:43,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:43,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:43,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:43,276 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,276 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:43,279 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:43,279 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:43,280 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:43,280 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,280 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:43,281 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,281 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,281 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:43,282 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,284 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,286 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,286 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,286 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:43,287 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:43,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:43,287 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,287 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:43,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:43,287 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:43,287 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,287 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:43,288 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:43,288 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:43,288 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,388 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:43,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:43,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:43,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:43,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,399 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:43,399 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:43,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:43,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:43,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,401 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,401 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:43,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:43,402 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,402 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:43,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,403 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:43,403 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:43,404 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:43,404 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:43,404 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:43,426 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313b2a58ca52614e2f942eca257e77db03 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313b2a58ca52614e2f942eca257e77db03 2023-02-11 00:53:43,838 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0e75ccb277e74a2b89c6ffbe77959778 2023-02-11 00:53:43,847 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/0e75ccb277e74a2b89c6ffbe77959778 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778 2023-02-11 00:53:43,855 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 00:53:43,856 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 452ms, sequenceid=25, compaction requested=true 2023-02-11 00:53:43,856 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:43,856 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:43,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:43,860 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,860 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,860 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,860 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@532bfb11[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:43,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:43,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,864 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,864 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:43,864 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:43,865 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:43,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:43,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,866 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,866 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:43,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:43,870 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:43,870 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:43,870 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:43,870 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,870 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:43,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:43,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:43,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:43,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,874 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,875 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:43,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,879 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,879 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:43,879 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:43,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:43,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:43,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:43,880 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:43,880 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,981 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:43,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:43,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,991 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:43,991 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:43,992 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:43,992 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:43,992 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,992 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,994 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:43,994 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:43,994 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:43,994 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:43,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:43,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:43,996 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:43,996 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:43,996 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:44,418 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019dcec8ab190c4732af7af49065905cb2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019dcec8ab190c4732af7af49065905cb2 2023-02-11 00:53:44,826 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/45c9754458cc4d3f9c941d30c4128c16 2023-02-11 00:53:44,834 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/45c9754458cc4d3f9c941d30c4128c16 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16 2023-02-11 00:53:44,842 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 00:53:44,843 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 847ms, sequenceid=29, compaction requested=true 2023-02-11 00:53:44,844 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:44,844 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:44,847 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:44,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26fd898f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:44,849 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:44,849 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,850 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:44,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:44,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:44,853 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:44,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:44,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:44,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:44,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:44,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:44,856 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:44,856 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:44,856 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:44,856 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,856 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:44,858 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,858 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,858 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:44,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:44,859 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,860 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:44,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:44,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:44,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:44,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:44,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:44,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:44,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 00:53:44,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,867 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:44,867 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:44,967 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:44,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:44,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:44,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:44,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,978 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:44,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:44,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:44,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:44,979 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,979 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,982 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:44,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:44,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:44,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,983 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:44,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:44,983 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:44,984 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:44,984 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:44,984 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:44,984 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:45,405 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103aa0b125d59b34035ba3a1a485bc4b4a6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa0b125d59b34035ba3a1a485bc4b4a6 2023-02-11 00:53:45,413 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/b812ae3a5da647a8b440e341707a79eb 2023-02-11 00:53:45,420 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/b812ae3a5da647a8b440e341707a79eb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb 2023-02-11 00:53:45,426 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 00:53:45,427 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 443ms, sequenceid=33, compaction requested=true 2023-02-11 00:53:45,428 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:45,428 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:45,428 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:45,428 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:45,428 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,428 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:45,428 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:45,430 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,430 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:45,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:45,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:45,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14547ab0[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:45,432 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:45,432 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,434 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:45,434 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,434 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:45,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:45,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:45,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:45,438 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:45,439 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:45,439 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:45,439 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,439 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:45,442 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,442 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:45,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,442 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:45,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:45,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:45,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,444 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,446 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:45,446 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,447 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:45,447 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:45,447 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:45,447 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:45,447 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,448 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,448 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,448 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,448 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:45,448 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:45,548 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:45,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:45,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:45,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:45,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,559 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:45,559 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:45,559 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:45,560 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:45,560 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,560 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,565 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:45,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:45,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:45,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,566 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:45,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:45,567 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:45,567 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:45,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:45,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:45,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:45,568 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:45,568 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:45,568 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:45,990 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071050a167fca64e389e9e6647c2f10b0d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509071050a167fca64e389e9e6647c2f10b0d 2023-02-11 00:53:46,399 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/bfe083ca29274b47a877beb0cb9e0378 2023-02-11 00:53:46,408 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/bfe083ca29274b47a877beb0cb9e0378 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378 2023-02-11 00:53:46,414 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 00:53:46,415 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 847ms, sequenceid=37, compaction requested=true 2023-02-11 00:53:46,416 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:46,416 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:46,416 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:46,416 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:46,416 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,416 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:46,416 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:46,418 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,418 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:46,418 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:46,418 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:46,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:46,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:46,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:46,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62676830[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:46,420 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:46,420 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,422 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:46,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:46,422 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,423 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:46,424 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:46,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:46,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:46,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:46,427 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:46,427 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:46,427 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:46,427 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,427 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:46,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:46,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:46,429 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,431 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:46,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:46,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:46,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:46,433 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,433 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:46,434 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:46,434 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:46,434 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:46,535 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:46,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:46,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:46,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:46,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,545 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:46,545 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:46,546 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 00:53:46,546 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 00:53:46,546 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,546 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,548 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,548 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:46,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:46,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:46,549 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:46,549 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:46,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:46,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 00:53:46,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 00:53:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 00:53:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:46,551 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:46,551 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. started... 2023-02-11 00:53:46,551 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4700892eb348df5c2d48ad6d6e217a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:46,971 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202ef6b9fdd72d4c39a17c2ee3219eab98 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202ef6b9fdd72d4c39a17c2ee3219eab98 2023-02-11 00:53:47,392 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/89519b3ae57b431da7317e72ea8552c1 2023-02-11 00:53:47,400 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/89519b3ae57b431da7317e72ea8552c1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1 2023-02-11 00:53:47,407 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 00:53:47,408 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4700892eb348df5c2d48ad6d6e217a96 in 857ms, sequenceid=41, compaction requested=true 2023-02-11 00:53:47,408 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:47,408 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 00:53:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 00:53:47,411 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,411 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:47,411 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,411 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:47,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 00:53:47,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e18e41e[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:47,413 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 00:53:47,413 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,414 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 00:53:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 00:53:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:47,414 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,414 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:47,419 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 00:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 00:53:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:47,423 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 00:53:47,423 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:47,423 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:47,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 00:53:47,423 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,423 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:47,425 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,425 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:47,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,425 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:47,426 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,427 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:47,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 00:53:47,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:47,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:47,429 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:47,429 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:47,430 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 00:53:47,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:47,430 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:47,430 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,430 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:47,430 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,530 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:47,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:47,536 DEBUG [Listener at localhost/36341] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 00:53:47,539 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 00:53:47,540 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:47,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:47,552 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:47,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:53:47,554 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077427554 2023-02-11 00:53:47,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:53:47,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 00:53:47,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:47,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x500a77fe to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:47,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@296896d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:47,565 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,032 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b4c7d8ac111c43499aa93b861600e938 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b4c7d8ac111c43499aa93b861600e938 2023-02-11 00:53:48,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:48,053 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:53:48,054 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:53:48,065 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:53:48,066 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:53:48,103 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7f83a26adf664ed198719c7fac7d3f52 first=Optional[r3] last=Optional[r6] 2023-02-11 00:53:48,118 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7f83a26adf664ed198719c7fac7d3f52}] 2023-02-11 00:53:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7f83a26adf664ed198719c7fac7d3f52 for inclusion in 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 00:53:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:53:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:48,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7f83a26adf664ed198719c7fac7d3f52 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1iuo8kc2rm1b78mvnh425un2na84vr9rmhebqucqku25fe840olk6uhd7pj1pjsi/family1/7f83a26adf664ed198719c7fac7d3f52 2023-02-11 00:53:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1iuo8kc2rm1b78mvnh425un2na84vr9rmhebqucqku25fe840olk6uhd7pj1pjsi/family1/7f83a26adf664ed198719c7fac7d3f52 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_ 2023-02-11 00:53:48,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1iuo8kc2rm1b78mvnh425un2na84vr9rmhebqucqku25fe840olk6uhd7pj1pjsi/family1/7f83a26adf664ed198719c7fac7d3f52 into 4700892eb348df5c2d48ad6d6e217a96/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_ - updating store file list. 2023-02-11 00:53:48,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_ into 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:48,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1iuo8kc2rm1b78mvnh425un2na84vr9rmhebqucqku25fe840olk6uhd7pj1pjsi/family1/7f83a26adf664ed198719c7fac7d3f52 into 4700892eb348df5c2d48ad6d6e217a96/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_) 2023-02-11 00:53:48,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1iuo8kc2rm1b78mvnh425un2na84vr9rmhebqucqku25fe840olk6uhd7pj1pjsi/family1/7f83a26adf664ed198719c7fac7d3f52 2023-02-11 00:53:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:53:48,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:53:48,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 4700892eb348df5c2d48ad6d6e217a96/family1 is initiating minor compaction 2023-02-11 00:53:48,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5b349a33; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:53:48,165 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4700892eb348df5c2d48ad6d6e217a96/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:48,165 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp, totalSize=50.2 K 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 98bde5ed47e841aa8d288c0314959f20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting acacb6c000bb489fa5ecece9f7d742ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 1a850c37bde242d4afede592e95b73eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 0f5f76c11881495caeee2f469c03257b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 0e75ccb277e74a2b89c6ffbe77959778, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 45c9754458cc4d3f9c941d30c4128c16, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b812ae3a5da647a8b440e341707a79eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting bfe083ca29274b47a877beb0cb9e0378, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 89519b3ae57b431da7317e72ea8552c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:53:48,166 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 27b8513e699b45739f5bad4e3f95d2df_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:53:48,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:48,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:53:48,186 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228720efa37276f4eb2afb22591a737fb41 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228720efa37276f4eb2afb22591a737fb41 2023-02-11 00:53:48,188 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313b2a58ca52614e2f942eca257e77db03 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313b2a58ca52614e2f942eca257e77db03 2023-02-11 00:53:48,190 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019dcec8ab190c4732af7af49065905cb2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019dcec8ab190c4732af7af49065905cb2 2023-02-11 00:53:48,192 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa0b125d59b34035ba3a1a485bc4b4a6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa0b125d59b34035ba3a1a485bc4b4a6 2023-02-11 00:53:48,192 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-11 00:53:48,192 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 00:53:48,192 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,192 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:48,219 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4700892eb348df5c2d48ad6d6e217a96#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:53:49,050 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/b7c2a3fbb481410b8f41f537f0478676 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b7c2a3fbb481410b8f41f537f0478676 2023-02-11 00:53:49,066 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4700892eb348df5c2d48ad6d6e217a96/family1 of 4700892eb348df5c2d48ad6d6e217a96 into b7c2a3fbb481410b8f41f537f0478676(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:53:49,066 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:49,067 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676076828163; duration=0sec 2023-02-11 00:53:49,069 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:53:49,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_] to archive 2023-02-11 00:53:49,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:53:49,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/98bde5ed47e841aa8d288c0314959f20 2023-02-11 00:53:49,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/acacb6c000bb489fa5ecece9f7d742ba 2023-02-11 00:53:49,089 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a38291349d714268ae301727c00a9e55 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a38291349d714268ae301727c00a9e55 2023-02-11 00:53:49,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/1a850c37bde242d4afede592e95b73eb 2023-02-11 00:53:49,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:49,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0f5f76c11881495caeee2f469c03257b 2023-02-11 00:53:49,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0e75ccb277e74a2b89c6ffbe77959778 2023-02-11 00:53:49,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/45c9754458cc4d3f9c941d30c4128c16 2023-02-11 00:53:49,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b812ae3a5da647a8b440e341707a79eb 2023-02-11 00:53:49,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/bfe083ca29274b47a877beb0cb9e0378 2023-02-11 00:53:49,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/89519b3ae57b431da7317e72ea8552c1 2023-02-11 00:53:49,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/27b8513e699b45739f5bad4e3f95d2df_SeqId_44_ 2023-02-11 00:53:49,122 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ab43f3dcc0064ac7a41965fba5852dfa first=Optional[r00] last=Optional[r2] 2023-02-11 00:53:49,123 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ab43f3dcc0064ac7a41965fba5852dfa}] 2023-02-11 00:53:49,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ab43f3dcc0064ac7a41965fba5852dfa for inclusion in 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:49,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 00:53:49,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:53:49,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:49,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ab43f3dcc0064ac7a41965fba5852dfa to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0bt0c92geuas8o5ur93mvf0em6t0oka0e699rrttprnko62gnf8jm8nlccac27l/family1/ab43f3dcc0064ac7a41965fba5852dfa 2023-02-11 00:53:49,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0bt0c92geuas8o5ur93mvf0em6t0oka0e699rrttprnko62gnf8jm8nlccac27l/family1/ab43f3dcc0064ac7a41965fba5852dfa as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_ 2023-02-11 00:53:49,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0bt0c92geuas8o5ur93mvf0em6t0oka0e699rrttprnko62gnf8jm8nlccac27l/family1/ab43f3dcc0064ac7a41965fba5852dfa into 4700892eb348df5c2d48ad6d6e217a96/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_ - updating store file list. 2023-02-11 00:53:49,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_ into 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:49,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0bt0c92geuas8o5ur93mvf0em6t0oka0e699rrttprnko62gnf8jm8nlccac27l/family1/ab43f3dcc0064ac7a41965fba5852dfa into 4700892eb348df5c2d48ad6d6e217a96/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_) 2023-02-11 00:53:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0bt0c92geuas8o5ur93mvf0em6t0oka0e699rrttprnko62gnf8jm8nlccac27l/family1/ab43f3dcc0064ac7a41965fba5852dfa 2023-02-11 00:53:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:53:49,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:53:49,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 4700892eb348df5c2d48ad6d6e217a96/family1 is initiating minor compaction (all files) 2023-02-11 00:53:49,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@571da822; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:53:49,147 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4700892eb348df5c2d48ad6d6e217a96/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:49,148 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b7c2a3fbb481410b8f41f537f0478676, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp, totalSize=358.6 K 2023-02-11 00:53:49,148 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 0659ef7ddcac42089c7e50794808ec0d, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:53:49,149 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b7c2a3fbb481410b8f41f537f0478676, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:53:49,150 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837900 2023-02-11 00:53:49,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:49,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:53:49,153 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511308e1ed1ce5d1945b5be38e608b32623bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511308e1ed1ce5d1945b5be38e608b32623bc 2023-02-11 00:53:49,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201060cb252840f4252b56755004f89a61a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201060cb252840f4252b56755004f89a61a 2023-02-11 00:53:49,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120589c319334a5146738150f152ee1c5054 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120589c319334a5146738150f152ee1c5054 2023-02-11 00:53:49,156 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-11 00:53:49,156 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 00:53:49,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:49,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:49,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:53:49,158 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:49,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6130 sec 2023-02-11 00:53:49,188 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4700892eb348df5c2d48ad6d6e217a96#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:53:49,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 00:53:49,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:49,735 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 00:53:49,736 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:49,736 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 00:53:49,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-11 00:53:49,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, REOPEN/MOVE}] 2023-02-11 00:53:49,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, REOPEN/MOVE 2023-02-11 00:53:49,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:49,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076829755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076829755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076829755"}]},"ts":"1676076829755"} 2023-02-11 00:53:49,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:49,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4700892eb348df5c2d48ad6d6e217a96, disabling compactions & flushes 2023-02-11 00:53:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,025 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/.tmp/family1/473b5272028640049a2f50397893b5fd as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/473b5272028640049a2f50397893b5fd 2023-02-11 00:53:50,032 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4700892eb348df5c2d48ad6d6e217a96/family1 of 4700892eb348df5c2d48ad6d6e217a96 into 473b5272028640049a2f50397893b5fd(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:53:50,032 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:50,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. after waiting 0 ms 2023-02-11 00:53:50,032 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676076829147; duration=0sec 2023-02-11 00:53:50,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,032 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:53:50,034 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b7c2a3fbb481410b8f41f537f0478676, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_] to archive 2023-02-11 00:53:50,035 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:53:50,037 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/0659ef7ddcac42089c7e50794808ec0d 2023-02-11 00:53:50,039 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b7c2a3fbb481410b8f41f537f0478676 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/b7c2a3fbb481410b8f41f537f0478676 2023-02-11 00:53:50,040 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/c60a0b1b152645fdbfd67b4f9a73149f_SeqId_47_ 2023-02-11 00:53:50,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 00:53:50,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4700892eb348df5c2d48ad6d6e217a96: Waiting for close lock at 1676076829916Running coprocessor pre-close hooks at 1676076829916Disabling compacts and flushes for region at 1676076829916Disabling writes for close at 1676076830032 (+116 ms)Writing region close event to WAL at 1676076830043 (+11 ms)Running coprocessor post-close hooks at 1676076830047 (+4 ms)Closed at 1676076830048 (+1 ms) 2023-02-11 00:53:50,048 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 4700892eb348df5c2d48ad6d6e217a96 to self. 2023-02-11 00:53:50,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=CLOSED 2023-02-11 00:53:50,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076830051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076830051"}]},"ts":"1676076830051"} 2023-02-11 00:53:50,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 00:53:50,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915 in 296 msec 2023-02-11 00:53:50,057 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=true 2023-02-11 00:53:50,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:50,208 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076830207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076830207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076830207"}]},"ts":"1676076830207"} 2023-02-11 00:53:50,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:50,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4700892eb348df5c2d48ad6d6e217a96, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:50,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:50,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,369 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,370 DEBUG [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:50,370 DEBUG [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:50,370 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4700892eb348df5c2d48ad6d6e217a96 columnFamilyName family1 2023-02-11 00:53:50,377 DEBUG [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/473b5272028640049a2f50397893b5fd 2023-02-11 00:53:50,378 INFO [StoreOpener-4700892eb348df5c2d48ad6d6e217a96-1] regionserver.HStore(310): Store=4700892eb348df5c2d48ad6d6e217a96/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:50,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:53:50,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4700892eb348df5c2d48ad6d6e217a96; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63762077, jitterRate=-0.049871012568473816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:53:50,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4700892eb348df5c2d48ad6d6e217a96: Running coprocessor pre-open hook at 1676076830368Writing region info on filesystem at 1676076830368Initializing all the Stores at 1676076830368Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676076830369 (+1 ms)Cleaning up temporary data from old regions at 1676076830381 (+12 ms)Cleaning up detritus from prior splits at 1676076830382 (+1 ms)Running coprocessor post-open hooks at 1676076830385 (+3 ms)Region opened successfully at 1676076830385 2023-02-11 00:53:50,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., pid=17, masterSystemTime=1676076830363 2023-02-11 00:53:50,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:53:50,388 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4700892eb348df5c2d48ad6d6e217a96, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:50,389 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676076830388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076830388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076830388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076830388"}]},"ts":"1676076830388"} 2023-02-11 00:53:50,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-11 00:53:50,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 4700892eb348df5c2d48ad6d6e217a96, server=jenkins-hbase4.apache.org,43697,1676076813915 in 179 msec 2023-02-11 00:53:50,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-11 00:53:50,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=4700892eb348df5c2d48ad6d6e217a96, REOPEN/MOVE in 639 msec 2023-02-11 00:53:50,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-11 00:53:50,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 655 msec 2023-02-11 00:53:50,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0820 sec 2023-02-11 00:53:50,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-11 00:53:50,411 INFO [Listener at localhost/36341] compactions.TestMobCompactor(278): alter status finished 2023-02-11 00:53:50,412 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 00:53:50,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:50,415 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:50,416 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077430416 2023-02-11 00:53:50,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:53:50,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:53:50,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 00:53:50,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:50,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x00b750bf to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:50,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425984e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:50,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:50,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:50,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:50,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:50,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:51,259 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128df43cb3f75ce4ecf9e2e7879980b3dd2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128df43cb3f75ce4ecf9e2e7879980b3dd2 2023-02-11 00:53:51,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:51,273 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:53:51,274 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44062, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:53:51,281 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:53:51,283 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:53:51,293 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6280fbe5c8c4f52a1ab51908e6de73b first=Optional[r05] last=Optional[r8] 2023-02-11 00:53:51,294 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6280fbe5c8c4f52a1ab51908e6de73b}] 2023-02-11 00:53:51,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6280fbe5c8c4f52a1ab51908e6de73b for inclusion in 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:51,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 00:53:51,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:53:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4700892eb348df5c2d48ad6d6e217a96: 2023-02-11 00:53:51,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6280fbe5c8c4f52a1ab51908e6de73b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__am5mkbq7jjjp8jibg8ikpmooign4i0kopr3aq8lblddr0of2sintsb719gdl1qcm/family1/a6280fbe5c8c4f52a1ab51908e6de73b 2023-02-11 00:53:51,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__am5mkbq7jjjp8jibg8ikpmooign4i0kopr3aq8lblddr0of2sintsb719gdl1qcm/family1/a6280fbe5c8c4f52a1ab51908e6de73b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/8ce9c3ab6b3249b891a7f2378759882d_SeqId_53_ 2023-02-11 00:53:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__am5mkbq7jjjp8jibg8ikpmooign4i0kopr3aq8lblddr0of2sintsb719gdl1qcm/family1/a6280fbe5c8c4f52a1ab51908e6de73b into 4700892eb348df5c2d48ad6d6e217a96/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/8ce9c3ab6b3249b891a7f2378759882d_SeqId_53_ - updating store file list. 2023-02-11 00:53:51,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/8ce9c3ab6b3249b891a7f2378759882d_SeqId_53_ into 4700892eb348df5c2d48ad6d6e217a96/family1 2023-02-11 00:53:51,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__am5mkbq7jjjp8jibg8ikpmooign4i0kopr3aq8lblddr0of2sintsb719gdl1qcm/family1/a6280fbe5c8c4f52a1ab51908e6de73b into 4700892eb348df5c2d48ad6d6e217a96/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/family1/8ce9c3ab6b3249b891a7f2378759882d_SeqId_53_) 2023-02-11 00:53:51,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__am5mkbq7jjjp8jibg8ikpmooign4i0kopr3aq8lblddr0of2sintsb719gdl1qcm/family1/a6280fbe5c8c4f52a1ab51908e6de73b 2023-02-11 00:53:51,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:51,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:53:51,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202ef6b9fdd72d4c39a17c2ee3219eab98 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202ef6b9fdd72d4c39a17c2ee3219eab98 2023-02-11 00:53:51,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c33f5ec5bd474840aea8a67bbe4bc64c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c33f5ec5bd474840aea8a67bbe4bc64c 2023-02-11 00:53:51,322 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-11 00:53:51,322 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 00:53:51,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:51,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:51,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 00:53:51,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 00:53:51,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:53:51,324 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 00:53:51,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 911 msec 2023-02-11 00:53:51,418 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 211) Potentially hanging thread: (jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x00b750bf-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x00b750bf-SendThread(127.0.0.1:63942) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40230 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xba6456e-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40178 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40212 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40144 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb7a6bf1-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40130 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40068 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x500a77fe-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0xb7a6bf1-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40032 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40114 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:43697-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40186 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x500a77fe sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/975763515.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40302 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40290 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40180 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40092 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xba6456e-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x00b750bf sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/975763515.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40194 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:40100 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1933903629_15 at /127.0.0.1:40244 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xb7a6bf1-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x500a77fe-SendThread(127.0.0.1:63942) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 332), ProcessCount=168 (was 168), AvailableMemoryMB=4024 (was 4158) 2023-02-11 00:53:51,431 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=168, AvailableMemoryMB=4024 2023-02-11 00:53:51,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 00:53:51,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:51,436 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:53:51,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-11 00:53:51,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:53:51,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:51,439 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:51,440 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e empty. 2023-02-11 00:53:51,440 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:51,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-11 00:53:51,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:51,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:51,851 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 00:53:51,853 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 533d184e0a7efe24165b6d1bd587d20e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:53:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 533d184e0a7efe24165b6d1bd587d20e, disabling compactions & flushes 2023-02-11 00:53:52,260 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. after waiting 0 ms 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,260 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,260 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 533d184e0a7efe24165b6d1bd587d20e: Waiting for close lock at 1676076832260Disabling compacts and flushes for region at 1676076832260Disabling writes for close at 1676076832260Writing region close event to WAL at 1676076832260Closed at 1676076832260 2023-02-11 00:53:52,263 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:53:52,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076832264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076832264"}]},"ts":"1676076832264"} 2023-02-11 00:53:52,266 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:53:52,267 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:53:52,267 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076832267"}]},"ts":"1676076832267"} 2023-02-11 00:53:52,268 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 00:53:52,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=533d184e0a7efe24165b6d1bd587d20e, ASSIGN}] 2023-02-11 00:53:52,273 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=533d184e0a7efe24165b6d1bd587d20e, ASSIGN 2023-02-11 00:53:52,274 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=533d184e0a7efe24165b6d1bd587d20e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:53:52,425 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=533d184e0a7efe24165b6d1bd587d20e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:52,425 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076832425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076832425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076832425"}]},"ts":"1676076832425"} 2023-02-11 00:53:52,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 533d184e0a7efe24165b6d1bd587d20e, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:53:52,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:52,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 533d184e0a7efe24165b6d1bd587d20e, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:53:52,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:53:52,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,585 INFO [StoreOpener-533d184e0a7efe24165b6d1bd587d20e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,586 DEBUG [StoreOpener-533d184e0a7efe24165b6d1bd587d20e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:53:52,586 DEBUG [StoreOpener-533d184e0a7efe24165b6d1bd587d20e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:53:52,586 INFO [StoreOpener-533d184e0a7efe24165b6d1bd587d20e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 533d184e0a7efe24165b6d1bd587d20e columnFamilyName family1 2023-02-11 00:53:52,588 INFO [StoreOpener-533d184e0a7efe24165b6d1bd587d20e-1] regionserver.HStore(310): Store=533d184e0a7efe24165b6d1bd587d20e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:53:52,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:53:52,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:53:52,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 533d184e0a7efe24165b6d1bd587d20e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69434295, jitterRate=0.03465162217617035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:53:52,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 533d184e0a7efe24165b6d1bd587d20e: Running coprocessor pre-open hook at 1676076832583Writing region info on filesystem at 1676076832583Initializing all the Stores at 1676076832584 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676076832584Cleaning up temporary data from old regions at 1676076832590 (+6 ms)Cleaning up detritus from prior splits at 1676076832591 (+1 ms)Running coprocessor post-open hooks at 1676076832596 (+5 ms)Region opened successfully at 1676076832596 2023-02-11 00:53:52,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e., pid=21, masterSystemTime=1676076832579 2023-02-11 00:53:52,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:52,599 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=533d184e0a7efe24165b6d1bd587d20e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:52,599 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076832599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076832599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076832599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076832599"}]},"ts":"1676076832599"} 2023-02-11 00:53:52,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 00:53:52,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 533d184e0a7efe24165b6d1bd587d20e, server=jenkins-hbase4.apache.org,43697,1676076813915 in 174 msec 2023-02-11 00:53:52,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-11 00:53:52,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=533d184e0a7efe24165b6d1bd587d20e, ASSIGN in 332 msec 2023-02-11 00:53:52,605 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:53:52,606 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076832606"}]},"ts":"1676076832606"} 2023-02-11 00:53:52,607 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 00:53:52,610 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:53:52,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1760 sec 2023-02-11 00:53:53,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 00:53:53,544 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-11 00:53:53,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:53,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,576 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:53,577 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:53,577 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:53,577 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:53,578 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,578 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,579 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:53,579 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:53,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:53,579 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:53,580 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:53,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:53,582 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:53,582 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:53,583 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:53:53,839 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:54,011 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303073952ca3a442efa7096d62c85e295a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303073952ca3a442efa7096d62c85e295a 2023-02-11 00:53:54,416 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/c5579f8c981c4da59bc31a00fb33def7 2023-02-11 00:53:54,424 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/c5579f8c981c4da59bc31a00fb33def7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c5579f8c981c4da59bc31a00fb33def7 2023-02-11 00:53:54,430 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c5579f8c981c4da59bc31a00fb33def7, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 00:53:54,431 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 849ms, sequenceid=5, compaction requested=false 2023-02-11 00:53:54,431 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:54,432 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:54,432 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:54,434 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:54,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:54,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:54,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2463b9a3[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:54,436 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:54,436 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,437 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,437 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:54,437 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:54,437 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:54,438 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,438 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:54,440 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:54,443 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:54,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:54,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:54,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,443 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:54,445 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,445 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:54,445 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:54,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:54,446 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,447 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,450 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,450 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:54,450 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:54,450 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:54,450 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:54,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:54,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:54,450 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:54,451 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:54,551 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:54,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:54,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:54,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,561 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:54,561 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:54,562 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:54,562 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:54,562 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,562 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,564 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,564 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:54,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:54,564 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:54,564 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,565 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:54,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:54,566 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:54,566 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:54,566 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:54,566 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:54,566 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:54,566 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:54,566 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:54,567 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:53:54,586 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ab840850de774803a1f25f4db36b8662 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab840850de774803a1f25f4db36b8662 2023-02-11 00:53:54,994 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/f234ce3a9c2440ad806646d46adf3b50 2023-02-11 00:53:55,002 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/f234ce3a9c2440ad806646d46adf3b50 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50 2023-02-11 00:53:55,008 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:53:55,009 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 442ms, sequenceid=9, compaction requested=false 2023-02-11 00:53:55,009 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:55,009 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,010 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:55,010 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:55,013 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,013 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,013 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,013 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:55,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1355c665[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:55,015 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:55,015 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,016 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:55,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:55,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:55,016 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,016 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:55,017 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:55,018 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,017 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,018 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:55,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:55,021 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:55,021 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:55,021 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:55,021 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,021 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:55,023 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,023 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,023 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,024 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,025 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,033 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:55,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:53:55,034 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:55,034 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:55,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,134 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:55,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:55,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:55,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:55,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,144 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,144 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,145 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:55,145 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:55,145 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,146 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,147 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,147 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,147 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,148 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,149 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,152 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:55,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:55,153 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:55,153 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,153 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:55,153 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:55,153 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:55,168 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201089fd1dacb0041e3b034316d36f57662 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201089fd1dacb0041e3b034316d36f57662 2023-02-11 00:53:55,178 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/ac7f95a500734e4f9e3339205938300c 2023-02-11 00:53:55,184 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/ac7f95a500734e4f9e3339205938300c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c 2023-02-11 00:53:55,189 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 00:53:55,190 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 37ms, sequenceid=13, compaction requested=true 2023-02-11 00:53:55,191 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:55,191 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:55,193 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,193 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:55,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a2a1ad7[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:55,194 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:55,194 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,196 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:55,196 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,196 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:55,196 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:55,199 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:55,199 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,199 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,199 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:55,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:55,201 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:55,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:55,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:55,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,202 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:55,203 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,203 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,203 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,204 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,206 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:53:55,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,216 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:55,216 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,217 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,217 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,217 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,217 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:55,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,217 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:55,318 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:55,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:55,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:55,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:55,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,329 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,330 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:55,330 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:55,331 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,331 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,332 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:55,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,333 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:55,333 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:55,334 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,334 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:55,334 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:55,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:53:55,752 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b698ab46e68d4045b7a111d782f80c14 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b698ab46e68d4045b7a111d782f80c14 2023-02-11 00:53:55,767 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/9aeae5a3c44249bcab43df42cfcc0024 2023-02-11 00:53:55,776 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/9aeae5a3c44249bcab43df42cfcc0024 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024 2023-02-11 00:53:55,783 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 00:53:55,784 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 450ms, sequenceid=17, compaction requested=true 2023-02-11 00:53:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:55,785 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:55,788 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:55,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@633b2f98[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:55,790 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:55,791 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,792 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:55,793 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,793 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:55,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:55,794 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:55,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:55,798 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:55,799 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:55,799 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:55,799 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,799 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:55,801 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,801 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,801 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:55,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,802 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,803 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,807 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,807 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,807 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,807 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:55,807 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:55,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:53:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,807 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:55,808 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,808 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,808 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,808 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:55,809 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:55,809 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:55,909 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:55,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:55,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:55,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:55,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,920 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:55,920 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,920 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:55,920 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:55,921 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,921 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,922 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:55,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:55,923 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:55,923 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:55,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:55,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:55,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:55,928 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:55,928 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:55,928 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:55,928 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:55,928 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:55,948 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288e208d5f76134bd68484d5408b5da833 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e208d5f76134bd68484d5408b5da833 2023-02-11 00:53:56,358 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/1ebb210db17348a992052b45623847bb 2023-02-11 00:53:56,365 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/1ebb210db17348a992052b45623847bb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb 2023-02-11 00:53:56,370 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 00:53:56,371 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 443ms, sequenceid=21, compaction requested=true 2023-02-11 00:53:56,372 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:56,372 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:56,372 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:56,374 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,374 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:56,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aac3cfd[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:56,377 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:56,377 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,378 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:56,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:56,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:56,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:56,380 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,380 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,380 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:56,380 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:56,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:56,383 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:56,383 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:56,383 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:56,383 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,383 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:56,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:56,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,389 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,391 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,393 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,393 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:56,394 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:56,394 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:56,394 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:56,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:56,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:56,394 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,394 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,394 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,395 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,395 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,395 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:56,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:56,395 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:56,495 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:56,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:56,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:56,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:56,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,504 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:56,504 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:56,505 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:56,505 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:56,505 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,505 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,507 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:56,507 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:56,507 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,507 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:56,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,508 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:56,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,508 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:56,509 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:56,509 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:56,509 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:56,509 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:56,509 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:56,509 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:56,509 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:56,532 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123145e0098a5baa4c1ba1b5ee5c78f7c604 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123145e0098a5baa4c1ba1b5ee5c78f7c604 2023-02-11 00:53:56,941 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/f1518d3b38044451ac6ca3ba24c6e897 2023-02-11 00:53:56,948 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/f1518d3b38044451ac6ca3ba24c6e897 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897 2023-02-11 00:53:56,955 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 00:53:56,956 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 447ms, sequenceid=25, compaction requested=true 2023-02-11 00:53:56,956 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:56,956 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:56,958 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,959 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f7af23[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:56,960 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:56,960 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,962 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,962 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:56,963 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:56,963 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,963 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:56,964 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:56,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:56,967 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:56,967 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:56,967 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:56,967 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,967 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:56,969 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,969 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,969 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:56,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:56,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:56,970 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,971 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:56,973 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:56,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:56,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:56,973 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:56,974 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:56,974 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,974 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:56,974 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:56,975 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:56,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:57,075 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:57,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:57,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:57,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:57,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,087 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:57,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:57,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:57,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:57,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,091 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,091 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:57,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:57,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:57,091 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,091 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:57,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:57,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:57,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,108 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:57,108 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:57,109 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:57,109 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:57,109 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:57,109 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:57,109 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:57,109 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:57,533 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b3dbdf50b1b54d2aa69134dc4c48a1b4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b3dbdf50b1b54d2aa69134dc4c48a1b4 2023-02-11 00:53:57,556 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/be9a37378f654af0a635ccf54b58778d 2023-02-11 00:53:57,562 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/be9a37378f654af0a635ccf54b58778d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d 2023-02-11 00:53:57,567 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 00:53:57,568 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 459ms, sequenceid=29, compaction requested=true 2023-02-11 00:53:57,569 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:57,569 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:57,569 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:57,569 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:57,569 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,569 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:57,569 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,571 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:57,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:57,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:57,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:57,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d91eda8[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:57,573 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:57,573 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,574 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,574 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:57,574 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:57,574 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:57,574 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,574 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:57,575 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:57,575 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,575 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:57,576 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:57,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:57,579 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:57,579 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:57,579 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:57,579 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,579 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:57,586 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,586 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,587 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:57,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:57,587 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:57,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,589 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,591 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:57,592 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:57,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:57,592 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,592 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:57,592 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:57,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:57,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:57,592 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,593 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,693 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:57,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:57,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:57,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:57,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,705 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:57,705 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:57,706 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:57,706 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:57,706 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,707 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,708 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:57,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:57,708 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:57,708 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:57,708 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:57,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:57,710 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:57,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:57,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:57,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:57,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:57,712 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:57,733 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a67d7b2ec3f241f691f8d04739b0a274 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a67d7b2ec3f241f691f8d04739b0a274 2023-02-11 00:53:58,141 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/c36e79e4d2424852bc9296f0185aca49 2023-02-11 00:53:58,149 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/c36e79e4d2424852bc9296f0185aca49 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49 2023-02-11 00:53:58,157 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 00:53:58,158 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 446ms, sequenceid=33, compaction requested=true 2023-02-11 00:53:58,158 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:58,158 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:58,159 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:58,159 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,159 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:58,159 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:58,161 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,161 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,161 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,161 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:58,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47ec4a6d[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:58,163 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:58,163 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,164 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:58,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:58,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:58,165 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,165 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:58,171 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:58,175 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:58,175 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:58,175 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:58,175 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,175 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:58,177 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,177 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:58,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:58,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,178 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,180 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,180 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,184 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,185 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:58,185 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:58,185 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:58,185 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:58,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:58,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,185 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:58,186 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:58,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:58,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:58,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:53:58,286 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:58,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:58,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:58,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,296 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:58,296 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:58,296 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:58,296 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:58,297 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,297 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,302 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,302 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:58,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:58,302 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,302 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,303 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,303 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:58,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,303 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:58,304 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:58,304 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:58,304 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:58,304 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:58,721 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907400e7db12e7d4c1f8b4321f87ad7f984 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907400e7db12e7d4c1f8b4321f87ad7f984 2023-02-11 00:53:58,726 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/1aa813adb40e46109e818a283e4b27d2 2023-02-11 00:53:58,732 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/1aa813adb40e46109e818a283e4b27d2 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2 2023-02-11 00:53:58,737 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 00:53:58,738 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 434ms, sequenceid=37, compaction requested=true 2023-02-11 00:53:58,738 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:58,738 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:58,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c1cddb9[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:58,742 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:58,742 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,743 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,744 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:58,744 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:58,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:58,744 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:58,745 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:58,745 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:58,745 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,745 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:58,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:58,748 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:58,748 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:58,748 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:58,748 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,748 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:58,750 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,750 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:58,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:58,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,750 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:58,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:58,751 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,752 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,754 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,754 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:58,754 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:58,754 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:58,754 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:58,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:58,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:58,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:58,754 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:58,755 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:58,856 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:58,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:58,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:53:58,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:53:58,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,863 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:58,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:58,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:53:58,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:53:58,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:58,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:58,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:58,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:53:58,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:53:58,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,866 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:53:58,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:58,866 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:53:58,866 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:53:58,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:53:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:53:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:53:58,868 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:58,868 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. started... 2023-02-11 00:53:58,868 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 533d184e0a7efe24165b6d1bd587d20e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:53:59,284 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201f386040c8b54f069ad7a949b85e3147 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201f386040c8b54f069ad7a949b85e3147 2023-02-11 00:53:59,690 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/a51b12ae06fe4695829d1578490f4dea 2023-02-11 00:53:59,696 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/a51b12ae06fe4695829d1578490f4dea as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea 2023-02-11 00:53:59,707 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 00:53:59,709 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 533d184e0a7efe24165b6d1bd587d20e in 841ms, sequenceid=41, compaction requested=true 2023-02-11 00:53:59,709 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:53:59,709 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:53:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:53:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:53:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:53:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:53:59,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,710 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:59,711 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,711 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c8fbae[Count = 0] remaining members to acquire global barrier 2023-02-11 00:53:59,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:53:59,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:53:59,715 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,715 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:53:59,716 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:59,717 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:59,717 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:53:59,719 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:53:59,719 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:53:59,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:53:59,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,720 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:53:59,721 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,721 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:53:59,721 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:59,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,722 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:53:59,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,723 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:53:59,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 00:53:59,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:53:59,725 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:53:59,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:53:59,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:53:59,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:53:59,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:53:59,727 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:53:59,727 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,727 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:53:59,727 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,727 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,827 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:53:59,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:53:59,830 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-11 00:53:59,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:53:59,832 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:53:59,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:53:59,833 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077439833 2023-02-11 00:53:59,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:53:59,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 00:53:59,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:53:59,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x1710da3d to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:53:59,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19600a84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:53:59,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:00,678 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036380518216544af7804a6206358a3750 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601036380518216544af7804a6206358a3750 2023-02-11 00:54:00,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:00,693 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:00,694 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:00,702 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:00,704 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:00,718 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2dd692fe07a349d591e8cff9dca87439 first=Optional[r5] last=Optional[r6] 2023-02-11 00:54:00,719 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2dd692fe07a349d591e8cff9dca87439}] 2023-02-11 00:54:00,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2dd692fe07a349d591e8cff9dca87439 for inclusion in 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 00:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:54:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2dd692fe07a349d591e8cff9dca87439 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r88p2n1jgfi3f679vvrff2fva69hctrb7jstelg0c9qqp9agub9mqta13l0v2l5t/family1/2dd692fe07a349d591e8cff9dca87439 2023-02-11 00:54:00,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r88p2n1jgfi3f679vvrff2fva69hctrb7jstelg0c9qqp9agub9mqta13l0v2l5t/family1/2dd692fe07a349d591e8cff9dca87439 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_ 2023-02-11 00:54:00,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r88p2n1jgfi3f679vvrff2fva69hctrb7jstelg0c9qqp9agub9mqta13l0v2l5t/family1/2dd692fe07a349d591e8cff9dca87439 into 533d184e0a7efe24165b6d1bd587d20e/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_ - updating store file list. 2023-02-11 00:54:00,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_ into 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r88p2n1jgfi3f679vvrff2fva69hctrb7jstelg0c9qqp9agub9mqta13l0v2l5t/family1/2dd692fe07a349d591e8cff9dca87439 into 533d184e0a7efe24165b6d1bd587d20e/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_) 2023-02-11 00:54:00,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r88p2n1jgfi3f679vvrff2fva69hctrb7jstelg0c9qqp9agub9mqta13l0v2l5t/family1/2dd692fe07a349d591e8cff9dca87439 2023-02-11 00:54:00,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:54:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:54:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 533d184e0a7efe24165b6d1bd587d20e/family1 is initiating minor compaction 2023-02-11 00:54:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@e5648a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:00,744 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 533d184e0a7efe24165b6d1bd587d20e/family1 in testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:54:00,745 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp, totalSize=49.7 K 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting f234ce3a9c2440ad806646d46adf3b50, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting ac7f95a500734e4f9e3339205938300c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 9aeae5a3c44249bcab43df42cfcc0024, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 1ebb210db17348a992052b45623847bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting f1518d3b38044451ac6ca3ba24c6e897, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting be9a37378f654af0a635ccf54b58778d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c36e79e4d2424852bc9296f0185aca49, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 1aa813adb40e46109e818a283e4b27d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:54:00,745 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting a51b12ae06fe4695829d1578490f4dea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:54:00,746 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 925ace62d8154465a1b33fe077019241_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:54:00,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:00,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:00,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b3dbdf50b1b54d2aa69134dc4c48a1b4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101b3dbdf50b1b54d2aa69134dc4c48a1b4 2023-02-11 00:54:00,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a67d7b2ec3f241f691f8d04739b0a274 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a67d7b2ec3f241f691f8d04739b0a274 2023-02-11 00:54:00,752 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 00:54:00,752 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 00:54:00,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:00,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:00,803 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 533d184e0a7efe24165b6d1bd587d20e#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:00,823 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d581c31ac0584f62b60e099967cb708d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d581c31ac0584f62b60e099967cb708d 2023-02-11 00:54:00,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:00,853 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4565b9d6eebd4cb9a4dbc165e903a384 first=Optional[r1] last=Optional[r4] 2023-02-11 00:54:00,854 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4565b9d6eebd4cb9a4dbc165e903a384}] 2023-02-11 00:54:00,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4565b9d6eebd4cb9a4dbc165e903a384 for inclusion in 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 00:54:00,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:00,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:54:00,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4565b9d6eebd4cb9a4dbc165e903a384 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2bqc5bqkf6pip16ruadmcjill2n08tnc64ro1s1rq0nk5a0r6h5aeu65uepajegd/family1/4565b9d6eebd4cb9a4dbc165e903a384 2023-02-11 00:54:00,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2bqc5bqkf6pip16ruadmcjill2n08tnc64ro1s1rq0nk5a0r6h5aeu65uepajegd/family1/4565b9d6eebd4cb9a4dbc165e903a384 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/697b2232d2cc409383fcf9490e4bb101_SeqId_46_ 2023-02-11 00:54:00,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2bqc5bqkf6pip16ruadmcjill2n08tnc64ro1s1rq0nk5a0r6h5aeu65uepajegd/family1/4565b9d6eebd4cb9a4dbc165e903a384 into 533d184e0a7efe24165b6d1bd587d20e/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/697b2232d2cc409383fcf9490e4bb101_SeqId_46_ - updating store file list. 2023-02-11 00:54:00,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/697b2232d2cc409383fcf9490e4bb101_SeqId_46_ into 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2bqc5bqkf6pip16ruadmcjill2n08tnc64ro1s1rq0nk5a0r6h5aeu65uepajegd/family1/4565b9d6eebd4cb9a4dbc165e903a384 into 533d184e0a7efe24165b6d1bd587d20e/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/697b2232d2cc409383fcf9490e4bb101_SeqId_46_) 2023-02-11 00:54:00,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2bqc5bqkf6pip16ruadmcjill2n08tnc64ro1s1rq0nk5a0r6h5aeu65uepajegd/family1/4565b9d6eebd4cb9a4dbc165e903a384 2023-02-11 00:54:00,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:00,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:00,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201089fd1dacb0041e3b034316d36f57662 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201089fd1dacb0041e3b034316d36f57662 2023-02-11 00:54:00,876 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b698ab46e68d4045b7a111d782f80c14 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b698ab46e68d4045b7a111d782f80c14 2023-02-11 00:54:00,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e208d5f76134bd68484d5408b5da833 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e208d5f76134bd68484d5408b5da833 2023-02-11 00:54:00,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123145e0098a5baa4c1ba1b5ee5c78f7c604 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123145e0098a5baa4c1ba1b5ee5c78f7c604 2023-02-11 00:54:00,878 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 00:54:00,878 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 00:54:00,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:00,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:00,948 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113066abde9f3f8547c2a36606f0fdd217f9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113066abde9f3f8547c2a36606f0fdd217f9 2023-02-11 00:54:00,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:00,979 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be6cd9a2d1974ec6b06f04f80fe4344a first=Optional[r00] last=Optional[r8] 2023-02-11 00:54:00,979 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be6cd9a2d1974ec6b06f04f80fe4344a}] 2023-02-11 00:54:00,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be6cd9a2d1974ec6b06f04f80fe4344a for inclusion in 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 00:54:00,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:00,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:54:00,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/be6cd9a2d1974ec6b06f04f80fe4344a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tb8ns46vvv30q01e4e0oirkhg9jkaevpg76nf1sakhvm8lasnhia3mm9cpmd5aua/family1/be6cd9a2d1974ec6b06f04f80fe4344a 2023-02-11 00:54:00,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tb8ns46vvv30q01e4e0oirkhg9jkaevpg76nf1sakhvm8lasnhia3mm9cpmd5aua/family1/be6cd9a2d1974ec6b06f04f80fe4344a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/39e8a64adc33454fb9b00cac115b9edb_SeqId_48_ 2023-02-11 00:54:00,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tb8ns46vvv30q01e4e0oirkhg9jkaevpg76nf1sakhvm8lasnhia3mm9cpmd5aua/family1/be6cd9a2d1974ec6b06f04f80fe4344a into 533d184e0a7efe24165b6d1bd587d20e/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/39e8a64adc33454fb9b00cac115b9edb_SeqId_48_ - updating store file list. 2023-02-11 00:54:00,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/39e8a64adc33454fb9b00cac115b9edb_SeqId_48_ into 533d184e0a7efe24165b6d1bd587d20e/family1 2023-02-11 00:54:00,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tb8ns46vvv30q01e4e0oirkhg9jkaevpg76nf1sakhvm8lasnhia3mm9cpmd5aua/family1/be6cd9a2d1974ec6b06f04f80fe4344a into 533d184e0a7efe24165b6d1bd587d20e/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/39e8a64adc33454fb9b00cac115b9edb_SeqId_48_) 2023-02-11 00:54:00,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tb8ns46vvv30q01e4e0oirkhg9jkaevpg76nf1sakhvm8lasnhia3mm9cpmd5aua/family1/be6cd9a2d1974ec6b06f04f80fe4344a 2023-02-11 00:54:00,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-02-11 00:54:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 00:54:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 00:54:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(415): Not compacting testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. because compaction request was cancelled 2023-02-11 00:54:01,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:01,002 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:01,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201f386040c8b54f069ad7a949b85e3147 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201f386040c8b54f069ad7a949b85e3147 2023-02-11 00:54:01,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab840850de774803a1f25f4db36b8662 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab840850de774803a1f25f4db36b8662 2023-02-11 00:54:01,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303073952ca3a442efa7096d62c85e295a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303073952ca3a442efa7096d62c85e295a 2023-02-11 00:54:01,007 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 00:54:01,007 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 00:54:01,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:01,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:01,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:54:01,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:54:01,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:01,009 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:01,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.1790 sec 2023-02-11 00:54:01,186 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=266 (was 249) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52396 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52526 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52312 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103be2a0d82524d49b3944983ab297e045b java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52412 [Waiting for operation #37] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52284 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7afe0d80-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52442 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x1710da3d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/975763515.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52266 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52330 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x1710da3d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52474 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52456 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:63942@0x1710da3d-SendThread(127.0.0.1:63942) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Thread-466 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52242 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52378 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52382 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7afe0d80-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52356 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52540 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52426 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52334 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52440 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52464 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52468 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536597299_15 at /127.0.0.1:52326 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x411ddfba-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=633 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 288), ProcessCount=168 (was 168), AvailableMemoryMB=3687 (was 4024) 2023-02-11 00:54:01,204 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=266, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=168, AvailableMemoryMB=3683 2023-02-11 00:54:01,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:54:01,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:01,210 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:54:01,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-11 00:54:01,211 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:54:01,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 00:54:01,213 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,214 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3 empty. 2023-02-11 00:54:01,214 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,214 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-11 00:54:01,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 00:54:01,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 00:54:01,627 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:01,629 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0841ab8ecf7db94fc27d1a2ecb0c90b3, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:01,631 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/.tmp/family1/98a36a0f2fb14338afcda18985c18def as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/98a36a0f2fb14338afcda18985c18def 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 0841ab8ecf7db94fc27d1a2ecb0c90b3, disabling compactions & flushes 2023-02-11 00:54:01,643 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. after waiting 0 ms 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,643 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,643 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: Waiting for close lock at 1676076841643Disabling compacts and flushes for region at 1676076841643Disabling writes for close at 1676076841643Writing region close event to WAL at 1676076841643Closed at 1676076841643 2023-02-11 00:54:01,643 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 533d184e0a7efe24165b6d1bd587d20e/family1 of 533d184e0a7efe24165b6d1bd587d20e into 98a36a0f2fb14338afcda18985c18def(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:01,643 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 533d184e0a7efe24165b6d1bd587d20e: 2023-02-11 00:54:01,644 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676076840744; duration=0sec 2023-02-11 00:54:01,644 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:01,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:54:01,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076841647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076841647"}]},"ts":"1676076841647"} 2023-02-11 00:54:01,649 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:54:01,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:54:01,650 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076841650"}]},"ts":"1676076841650"} 2023-02-11 00:54:01,651 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 00:54:01,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0841ab8ecf7db94fc27d1a2ecb0c90b3, ASSIGN}] 2023-02-11 00:54:01,660 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0841ab8ecf7db94fc27d1a2ecb0c90b3, ASSIGN 2023-02-11 00:54:01,661 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0841ab8ecf7db94fc27d1a2ecb0c90b3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:01,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_] to archive 2023-02-11 00:54:01,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:01,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f234ce3a9c2440ad806646d46adf3b50 2023-02-11 00:54:01,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/ac7f95a500734e4f9e3339205938300c 2023-02-11 00:54:01,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/9aeae5a3c44249bcab43df42cfcc0024 2023-02-11 00:54:01,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1ebb210db17348a992052b45623847bb 2023-02-11 00:54:01,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/f1518d3b38044451ac6ca3ba24c6e897 2023-02-11 00:54:01,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/be9a37378f654af0a635ccf54b58778d 2023-02-11 00:54:01,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/c36e79e4d2424852bc9296f0185aca49 2023-02-11 00:54:01,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/1aa813adb40e46109e818a283e4b27d2 2023-02-11 00:54:01,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/a51b12ae06fe4695829d1578490f4dea 2023-02-11 00:54:01,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/family1/925ace62d8154465a1b33fe077019241_SeqId_44_ 2023-02-11 00:54:01,812 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0841ab8ecf7db94fc27d1a2ecb0c90b3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:01,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076841812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076841812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076841812"}]},"ts":"1676076841812"} 2023-02-11 00:54:01,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 0841ab8ecf7db94fc27d1a2ecb0c90b3, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:01,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 00:54:01,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0841ab8ecf7db94fc27d1a2ecb0c90b3, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:01,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:01,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,974 INFO [StoreOpener-0841ab8ecf7db94fc27d1a2ecb0c90b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,976 DEBUG [StoreOpener-0841ab8ecf7db94fc27d1a2ecb0c90b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:01,976 DEBUG [StoreOpener-0841ab8ecf7db94fc27d1a2ecb0c90b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:01,976 INFO [StoreOpener-0841ab8ecf7db94fc27d1a2ecb0c90b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0841ab8ecf7db94fc27d1a2ecb0c90b3 columnFamilyName family1 2023-02-11 00:54:01,978 INFO [StoreOpener-0841ab8ecf7db94fc27d1a2ecb0c90b3-1] regionserver.HStore(310): Store=0841ab8ecf7db94fc27d1a2ecb0c90b3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:54:01,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:01,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0841ab8ecf7db94fc27d1a2ecb0c90b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63689658, jitterRate=-0.05095013976097107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:01,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: Running coprocessor pre-open hook at 1676076841973Writing region info on filesystem at 1676076841973Initializing all the Stores at 1676076841974 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076841974Cleaning up temporary data from old regions at 1676076841980 (+6 ms)Cleaning up detritus from prior splits at 1676076841980Running coprocessor post-open hooks at 1676076841985 (+5 ms)Region opened successfully at 1676076841985 2023-02-11 00:54:01,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3., pid=25, masterSystemTime=1676076841968 2023-02-11 00:54:01,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:01,989 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0841ab8ecf7db94fc27d1a2ecb0c90b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:01,989 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076841989"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076841989"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076841989"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076841989"}]},"ts":"1676076841989"} 2023-02-11 00:54:01,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-11 00:54:01,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 0841ab8ecf7db94fc27d1a2ecb0c90b3, server=jenkins-hbase4.apache.org,43697,1676076813915 in 176 msec 2023-02-11 00:54:01,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-11 00:54:01,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0841ab8ecf7db94fc27d1a2ecb0c90b3, ASSIGN in 336 msec 2023-02-11 00:54:01,996 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:54:01,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076841996"}]},"ts":"1676076841996"} 2023-02-11 00:54:01,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 00:54:02,001 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:54:02,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 794 msec 2023-02-11 00:54:02,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 00:54:02,318 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-11 00:54:02,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:02,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,352 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:02,352 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:02,352 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:02,352 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:02,353 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,353 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,355 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:02,355 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:02,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:02,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:02,355 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:02,356 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,356 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:02,357 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:02,357 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:02,358 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:54:02,784 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113018df96da958944838a8a17357231b5b9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113018df96da958944838a8a17357231b5b9 2023-02-11 00:54:03,188 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/c58e9d5fdc404fd284df3bde1b350371 2023-02-11 00:54:03,195 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/c58e9d5fdc404fd284df3bde1b350371 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371 2023-02-11 00:54:03,201 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 00:54:03,202 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 844ms, sequenceid=5, compaction requested=false 2023-02-11 00:54:03,202 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:03,203 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:03,203 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:03,205 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:03,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:03,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c6be72[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:03,207 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:03,207 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,209 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:03,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:03,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:03,211 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:03,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:03,214 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:03,214 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:03,214 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:03,214 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,214 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:03,216 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,216 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:03,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,216 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:03,216 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,217 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:03,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,220 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:03,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:03,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:03,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:03,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:03,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:03,220 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:03,321 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:03,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:03,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:03,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:03,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,328 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:03,328 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:03,328 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:03,328 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:03,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:03,331 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:03,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:03,331 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:03,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,331 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:03,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:03,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:03,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:03,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:03,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:03,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:03,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:03,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:03,333 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:54:03,749 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c47c81b0cb6941c8b30b4ed42e23723b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128c47c81b0cb6941c8b30b4ed42e23723b 2023-02-11 00:54:04,155 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/485f2832ac6c4d5996354ea426ee556a 2023-02-11 00:54:04,162 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/485f2832ac6c4d5996354ea426ee556a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a 2023-02-11 00:54:04,167 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:54:04,169 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 836ms, sequenceid=9, compaction requested=false 2023-02-11 00:54:04,170 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:04,170 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:04,172 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:04,173 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,173 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:04,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:04,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@715c29a5[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:04,175 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:04,175 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,176 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:04,176 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:04,176 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,176 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:04,179 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:04,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,179 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:04,179 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:04,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:04,182 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:04,182 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:04,182 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:04,182 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,182 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:04,184 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,184 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:04,184 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:04,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:04,185 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:04,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:04,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,187 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,189 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,189 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,189 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:04,189 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:04,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:04,189 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:04,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:04,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:04,189 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:04,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:04,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:04,290 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:04,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,298 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:04,298 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:04,298 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:04,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:04,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,300 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:04,300 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:04,301 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,301 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:04,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,302 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,302 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:04,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:04,302 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:04,302 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:04,302 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:04,308 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:04,308 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:04,308 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:04,308 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:04,308 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:04,727 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201abb31c9114dd449f8a904bf3fd04076e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201abb31c9114dd449f8a904bf3fd04076e 2023-02-11 00:54:05,133 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/882ec036b4114f05965d8e4d7f35c02e 2023-02-11 00:54:05,139 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/882ec036b4114f05965d8e4d7f35c02e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e 2023-02-11 00:54:05,146 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 00:54:05,147 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 839ms, sequenceid=13, compaction requested=true 2023-02-11 00:54:05,148 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:05,148 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:05,148 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:05,148 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:05,148 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,148 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:05,148 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:05,150 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,150 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,150 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,150 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:05,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bb7c322[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:05,153 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:05,153 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,154 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,154 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:05,154 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:05,154 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:05,154 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,154 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:05,156 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:05,156 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:05,156 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,156 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:05,158 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:05,158 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:05,158 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:05,158 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,158 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:05,160 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,160 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,160 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:05,160 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,161 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,167 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:05,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:05,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:05,167 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:05,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:05,268 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:05,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:05,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:05,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:05,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,275 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:05,275 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:05,275 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:05,275 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:05,276 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,276 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,278 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,278 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:05,279 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,279 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,280 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,280 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:05,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:05,280 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:05,281 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:05,281 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:05,296 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120527147de720d44261b88fd610aead5b17 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120527147de720d44261b88fd610aead5b17 2023-02-11 00:54:05,702 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/9063ddda1f5844bbbfb902b53d6b2366 2023-02-11 00:54:05,709 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/9063ddda1f5844bbbfb902b53d6b2366 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366 2023-02-11 00:54:05,715 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 00:54:05,716 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 435ms, sequenceid=17, compaction requested=true 2023-02-11 00:54:05,716 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:05,716 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:05,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:05,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:05,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:05,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:05,718 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,718 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,719 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,719 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:05,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a435071[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:05,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:05,720 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,722 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:05,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:05,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:05,722 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,722 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:05,725 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,725 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,725 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,725 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:05,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:05,728 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:05,728 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:05,728 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:05,728 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,728 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:05,730 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,730 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:05,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,730 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:05,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:05,731 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:05,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,736 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,739 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:05,739 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:05,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:05,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:05,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,740 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:05,740 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:05,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:05,741 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:05,741 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:05,841 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:05,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:05,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:05,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:05,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,851 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:05,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:05,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:05,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:05,852 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,852 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,853 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:05,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:05,854 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,854 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:05,854 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:05,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:05,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:05,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:05,855 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:05,855 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:05,855 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:06,276 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285d8d115b57164363bd400ef63e9cfe1d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285d8d115b57164363bd400ef63e9cfe1d 2023-02-11 00:54:06,682 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/6f6792d8bd8e462884b57e56d2c78a27 2023-02-11 00:54:06,687 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/6f6792d8bd8e462884b57e56d2c78a27 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27 2023-02-11 00:54:06,692 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 00:54:06,694 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 839ms, sequenceid=21, compaction requested=true 2023-02-11 00:54:06,694 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:06,694 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:06,697 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,697 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,697 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,697 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:06,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:06,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b175a65[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:06,699 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:06,699 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,700 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,701 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:06,701 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:06,701 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:06,701 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,701 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:06,702 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,702 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:06,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,702 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:06,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,702 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:06,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:06,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:06,705 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:06,705 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:06,705 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:06,705 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,705 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:06,706 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,706 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,707 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,707 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,708 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:06,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:06,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:06,711 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:06,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:06,712 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:06,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:06,712 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,712 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,712 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:06,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:06,812 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:06,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:06,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:06,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:06,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,819 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:06,819 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:06,819 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:06,819 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:06,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,821 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,821 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:06,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:06,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,823 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,823 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:06,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,823 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:06,823 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:06,823 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:06,824 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:06,824 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:06,824 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:06,824 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:06,824 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:06,852 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a2148047cefc4abba58d145aaf20a91a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2148047cefc4abba58d145aaf20a91a 2023-02-11 00:54:06,860 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff 2023-02-11 00:54:06,866 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff 2023-02-11 00:54:06,873 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 00:54:06,874 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 50ms, sequenceid=25, compaction requested=true 2023-02-11 00:54:06,874 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:06,874 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:06,874 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:06,874 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:06,874 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,874 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:06,874 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,876 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:06,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b9657a3[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:06,878 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:06,878 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,879 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:06,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:06,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:06,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:06,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:06,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:06,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:06,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:06,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:06,888 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:06,888 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:06,888 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:06,888 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,888 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:06,896 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,897 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:06,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,897 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:06,897 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:06,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:06,899 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:06,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:06,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:06,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:06,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:06,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:06,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:06,902 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:06,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,903 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:06,903 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,903 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,903 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:06,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:06,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:06,905 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:06,905 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:07,005 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:07,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:07,050 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:07,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1710da3d to 127.0.0.1:63942 2023-02-11 00:54:07,051 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:07,054 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:07,054 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00b750bf to 127.0.0.1:63942 2023-02-11 00:54:07,054 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,054 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:07,054 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:07,054 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:07,054 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:07,058 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,058 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,059 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,059 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:07,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:07,059 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,059 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,061 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:07,062 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x500a77fe to 127.0.0.1:63942 2023-02-11 00:54:07,062 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:07,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:07,064 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:07,064 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:07,065 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:07,523 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019ebadc8cf89844cbb356ae8a6f8b1827 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019ebadc8cf89844cbb356ae8a6f8b1827 2023-02-11 00:54:07,549 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:54:07,930 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/309f5de1402f42b4b31ce12c20ac459f 2023-02-11 00:54:07,936 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/309f5de1402f42b4b31ce12c20ac459f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f 2023-02-11 00:54:07,940 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 00:54:07,941 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 876ms, sequenceid=29, compaction requested=true 2023-02-11 00:54:07,942 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:07,942 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,943 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:07,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:07,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2eed2520[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:07,945 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:07,945 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,947 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:07,947 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,947 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:07,949 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:07,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,949 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:07,949 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:07,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:07,951 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:07,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:07,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:07,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,951 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:07,952 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,952 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:07,952 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:07,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:07,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:07,953 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,954 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:07,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:07,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:07,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:07,956 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:07,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:07,957 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:07,956 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:07,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:07,957 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:07,957 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:07,957 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,057 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:08,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:08,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:08,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:08,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,063 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:08,063 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:08,063 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:08,063 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:08,064 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,064 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,066 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,066 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:08,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:08,066 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,066 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,067 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:08,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:08,068 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:08,068 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:08,068 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:08,481 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ea93baa407ad4b1eb0162c0886c5d826 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ea93baa407ad4b1eb0162c0886c5d826 2023-02-11 00:54:08,889 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/5717535104214af38bb6717fbd949452 2023-02-11 00:54:08,894 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/5717535104214af38bb6717fbd949452 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452 2023-02-11 00:54:08,900 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 00:54:08,901 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 833ms, sequenceid=33, compaction requested=true 2023-02-11 00:54:08,901 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:08,901 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:08,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:08,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:08,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:08,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:08,902 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:08,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ebd2854[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:08,904 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:08,904 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,905 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,905 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:08,905 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:08,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:08,905 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:08,907 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:08,907 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,907 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:08,907 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:08,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:08,910 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:08,910 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:08,910 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:08,910 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,910 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:08,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:08,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,916 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:08,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:08,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:08,917 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:08,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,918 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:08,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,921 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,921 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:08,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:08,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:08,922 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:08,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:08,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:08,922 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:08,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:08,923 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:09,023 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:09,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:09,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:09,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:09,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,030 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:09,030 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:09,030 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:09,030 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:09,030 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,030 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,032 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:09,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:09,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:09,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:09,034 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:09,034 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:09,034 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:09,450 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ed4ffcf223d54698b63694308353a687 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907ed4ffcf223d54698b63694308353a687 2023-02-11 00:54:09,857 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/50de9faf5c244977b8ef8bb30a125276 2023-02-11 00:54:09,862 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/50de9faf5c244977b8ef8bb30a125276 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276 2023-02-11 00:54:09,866 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 00:54:09,867 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 833ms, sequenceid=37, compaction requested=true 2023-02-11 00:54:09,867 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:09,867 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:09,869 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,869 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:09,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:09,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:09,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:09,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f289994[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:09,871 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:09,871 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,876 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:09,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:09,876 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,876 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:09,877 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,877 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:09,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:09,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:09,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:09,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:09,880 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:09,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:09,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:09,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,880 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:09,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:09,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,881 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:09,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:09,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:09,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:09,882 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:09,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:09,883 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:09,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,885 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:09,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:09,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:09,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:09,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:09,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:09,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,885 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:09,886 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:09,986 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:09,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:09,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:09,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:09,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,993 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:09,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:09,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:09,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:09,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,994 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,996 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:09,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:09,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:09,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:09,997 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:09,997 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:09,997 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:09,998 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:09,998 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:09,998 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:09,998 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. started... 2023-02-11 00:54:09,998 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0841ab8ecf7db94fc27d1a2ecb0c90b3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:10,411 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ed4de03f78eb4e2d9b2045b5306ab5a5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120ed4de03f78eb4e2d9b2045b5306ab5a5 2023-02-11 00:54:10,817 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/a20893bd8ffc4e529e2725bf4c01b5fb 2023-02-11 00:54:10,822 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/a20893bd8ffc4e529e2725bf4c01b5fb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb 2023-02-11 00:54:10,826 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 00:54:10,827 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0841ab8ecf7db94fc27d1a2ecb0c90b3 in 829ms, sequenceid=41, compaction requested=true 2023-02-11 00:54:10,827 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:10,827 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:10,827 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:10,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:10,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:10,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:10,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:10,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26caf09d[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:10,831 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:10,831 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:10,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:10,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:10,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:10,834 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,834 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:10,834 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:10,834 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:10,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:10,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:10,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:10,836 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:10,836 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:10,836 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:10,836 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,836 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:10,839 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,839 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:10,839 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:10,839 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,840 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,842 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,842 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,842 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,842 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:10,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:10,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:10,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:10,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 00:54:10,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:10,843 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:10,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,843 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:10,944 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:10,946 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-11 00:54:10,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:10,948 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:10,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:10,949 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077450949 2023-02-11 00:54:10,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:54:10,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 00:54:10,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:10,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x769df65e to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:10,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f30f623, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:10,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,796 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030bb9e0815a8540b7a7492d646aa86a03 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030bb9e0815a8540b7a7492d646aa86a03 2023-02-11 00:54:11,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:11,810 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:11,811 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:11,817 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:11,819 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:11,828 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2fe3da4322054e8483bf2df20d631e28 first=Optional[r3] last=Optional[r6] 2023-02-11 00:54:11,828 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2fe3da4322054e8483bf2df20d631e28}] 2023-02-11 00:54:11,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2fe3da4322054e8483bf2df20d631e28 for inclusion in 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:11,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 00:54:11,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:11,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:11,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2fe3da4322054e8483bf2df20d631e28 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__29m79joc2n3g5fjn2l523rbm2oph7m4r0tov3486qe05n9f3q0gvd66ivh4jfekd/family1/2fe3da4322054e8483bf2df20d631e28 2023-02-11 00:54:11,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__29m79joc2n3g5fjn2l523rbm2oph7m4r0tov3486qe05n9f3q0gvd66ivh4jfekd/family1/2fe3da4322054e8483bf2df20d631e28 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_ 2023-02-11 00:54:11,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__29m79joc2n3g5fjn2l523rbm2oph7m4r0tov3486qe05n9f3q0gvd66ivh4jfekd/family1/2fe3da4322054e8483bf2df20d631e28 into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_ - updating store file list. 2023-02-11 00:54:11,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_ into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:11,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__29m79joc2n3g5fjn2l523rbm2oph7m4r0tov3486qe05n9f3q0gvd66ivh4jfekd/family1/2fe3da4322054e8483bf2df20d631e28 into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_) 2023-02-11 00:54:11,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__29m79joc2n3g5fjn2l523rbm2oph7m4r0tov3486qe05n9f3q0gvd66ivh4jfekd/family1/2fe3da4322054e8483bf2df20d631e28 2023-02-11 00:54:11,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:54:11,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:54:11,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 is initiating minor compaction 2023-02-11 00:54:11,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f2c0af6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:11,850 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 in testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:11,851 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp, totalSize=50.0 K 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 485f2832ac6c4d5996354ea426ee556a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 882ec036b4114f05965d8e4d7f35c02e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 9063ddda1f5844bbbfb902b53d6b2366, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 6f6792d8bd8e462884b57e56d2c78a27, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting cc3c41bfe0df4765b25a1ee19a3bc0ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 309f5de1402f42b4b31ce12c20ac459f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 5717535104214af38bb6717fbd949452, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 50de9faf5c244977b8ef8bb30a125276, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting a20893bd8ffc4e529e2725bf4c01b5fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:54:11,851 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 360798414975468087a798fb0a56f695_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:54:11,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:11,854 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:11,856 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285d8d115b57164363bd400ef63e9cfe1d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285d8d115b57164363bd400ef63e9cfe1d 2023-02-11 00:54:11,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2148047cefc4abba58d145aaf20a91a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2148047cefc4abba58d145aaf20a91a 2023-02-11 00:54:11,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019ebadc8cf89844cbb356ae8a6f8b1827 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019ebadc8cf89844cbb356ae8a6f8b1827 2023-02-11 00:54:11,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ea93baa407ad4b1eb0162c0886c5d826 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ea93baa407ad4b1eb0162c0886c5d826 2023-02-11 00:54:11,861 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 00:54:11,861 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:11,888 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0841ab8ecf7db94fc27d1a2ecb0c90b3#family1#compaction#33 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:12,706 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120531dc01c20de74a00bbaf687bc5830239 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120531dc01c20de74a00bbaf687bc5830239 2023-02-11 00:54:12,707 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:12,708 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/29289b6dbf7341a4a6433ae5c897e48d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/29289b6dbf7341a4a6433ae5c897e48d 2023-02-11 00:54:12,715 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 of 0841ab8ecf7db94fc27d1a2ecb0c90b3 into 29289b6dbf7341a4a6433ae5c897e48d(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:12,715 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:12,716 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676076851850; duration=0sec 2023-02-11 00:54:12,716 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:12,736 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b6596f5a71494cf0be255590b8042cb8 first=Optional[r1] last=Optional[r2] 2023-02-11 00:54:12,736 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b6596f5a71494cf0be255590b8042cb8}] 2023-02-11 00:54:12,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b6596f5a71494cf0be255590b8042cb8 for inclusion in 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:12,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 00:54:12,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:12,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:12,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b6596f5a71494cf0be255590b8042cb8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pentodl02l47drcbjpknhj2jeudgrsrb47q9cfek7ejqoq12odbcc41d90bprg3k/family1/b6596f5a71494cf0be255590b8042cb8 2023-02-11 00:54:12,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pentodl02l47drcbjpknhj2jeudgrsrb47q9cfek7ejqoq12odbcc41d90bprg3k/family1/b6596f5a71494cf0be255590b8042cb8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_ 2023-02-11 00:54:12,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pentodl02l47drcbjpknhj2jeudgrsrb47q9cfek7ejqoq12odbcc41d90bprg3k/family1/b6596f5a71494cf0be255590b8042cb8 into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_ - updating store file list. 2023-02-11 00:54:12,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_ into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 2023-02-11 00:54:12,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pentodl02l47drcbjpknhj2jeudgrsrb47q9cfek7ejqoq12odbcc41d90bprg3k/family1/b6596f5a71494cf0be255590b8042cb8 into 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_) 2023-02-11 00:54:12,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pentodl02l47drcbjpknhj2jeudgrsrb47q9cfek7ejqoq12odbcc41d90bprg3k/family1/b6596f5a71494cf0be255590b8042cb8 2023-02-11 00:54:12,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:54:12,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:54:12,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 is initiating minor compaction (all files) 2023-02-11 00:54:12,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5703e3d2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:12,755 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 in testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:54:12,755 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/29289b6dbf7341a4a6433ae5c897e48d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp, totalSize=176.8 K 2023-02-11 00:54:12,756 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c58e9d5fdc404fd284df3bde1b350371, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:54:12,756 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 29289b6dbf7341a4a6433ae5c897e48d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:54:12,757 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting d8e05f5336744151a059df10967d8a94_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237900 2023-02-11 00:54:12,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:12,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:12,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201abb31c9114dd449f8a904bf3fd04076e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201abb31c9114dd449f8a904bf3fd04076e 2023-02-11 00:54:12,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120527147de720d44261b88fd610aead5b17 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120527147de720d44261b88fd610aead5b17 2023-02-11 00:54:12,762 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-11 00:54:12,762 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 00:54:12,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:12,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:12,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:12,764 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:12,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8170 sec 2023-02-11 00:54:12,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_] to archive 2023-02-11 00:54:12,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:12,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/485f2832ac6c4d5996354ea426ee556a 2023-02-11 00:54:12,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/882ec036b4114f05965d8e4d7f35c02e 2023-02-11 00:54:12,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/9063ddda1f5844bbbfb902b53d6b2366 2023-02-11 00:54:12,802 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0841ab8ecf7db94fc27d1a2ecb0c90b3#family1#compaction#34 average throughput is 4.42 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:12,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/6f6792d8bd8e462884b57e56d2c78a27 2023-02-11 00:54:12,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/cc3c41bfe0df4765b25a1ee19a3bc0ff 2023-02-11 00:54:12,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/309f5de1402f42b4b31ce12c20ac459f 2023-02-11 00:54:12,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/5717535104214af38bb6717fbd949452 2023-02-11 00:54:12,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/50de9faf5c244977b8ef8bb30a125276 2023-02-11 00:54:12,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/a20893bd8ffc4e529e2725bf4c01b5fb 2023-02-11 00:54:12,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/360798414975468087a798fb0a56f695_SeqId_44_ 2023-02-11 00:54:12,894 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253 (was 266), OpenFileDescriptor=598 (was 633), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 260), ProcessCount=168 (was 168), AvailableMemoryMB=3354 (was 3683) 2023-02-11 00:54:12,908 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=168, AvailableMemoryMB=3352 2023-02-11 00:54:12,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 00:54:12,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:12,917 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:54:12,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-11 00:54:12,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:54:12,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:12,921 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672 2023-02-11 00:54:12,924 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:12,924 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:12,924 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672 empty. 2023-02-11 00:54:12,925 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55 empty. 2023-02-11 00:54:12,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672 2023-02-11 00:54:12,925 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669 empty. 2023-02-11 00:54:12,925 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:12,926 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:12,926 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-11 00:54:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:13,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:13,242 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/.tmp/family1/e914a3eed677425784517f0deec5439e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/e914a3eed677425784517f0deec5439e 2023-02-11 00:54:13,247 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0841ab8ecf7db94fc27d1a2ecb0c90b3/family1 of 0841ab8ecf7db94fc27d1a2ecb0c90b3 into e914a3eed677425784517f0deec5439e(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:13,247 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: 2023-02-11 00:54:13,248 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676076852755; duration=0sec 2023-02-11 00:54:13,248 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:13,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/29289b6dbf7341a4a6433ae5c897e48d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_] to archive 2023-02-11 00:54:13,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:13,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/c58e9d5fdc404fd284df3bde1b350371 2023-02-11 00:54:13,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/29289b6dbf7341a4a6433ae5c897e48d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/29289b6dbf7341a4a6433ae5c897e48d 2023-02-11 00:54:13,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/family1/d8e05f5336744151a059df10967d8a94_SeqId_47_ 2023-02-11 00:54:13,347 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:13,349 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2ae39e54d1127650946f335a6cc7dd55, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:13,349 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 150784ae1670fd37287c48625f800672, NAME => 'testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:13,349 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => d42d4a3686689b68f0a67d076f2a5669, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:13,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing d42d4a3686689b68f0a67d076f2a5669, disabling compactions & flushes 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 2ae39e54d1127650946f335a6cc7dd55, disabling compactions & flushes 2023-02-11 00:54:13,757 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. after waiting 0 ms 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:13,757 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:13,757 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 150784ae1670fd37287c48625f800672, disabling compactions & flushes 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for d42d4a3686689b68f0a67d076f2a5669: Waiting for close lock at 1676076853757Disabling compacts and flushes for region at 1676076853757Disabling writes for close at 1676076853757Writing region close event to WAL at 1676076853757Closed at 1676076853757 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. after waiting 0 ms 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:13,757 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:13,757 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 2ae39e54d1127650946f335a6cc7dd55: Waiting for close lock at 1676076853757Disabling compacts and flushes for region at 1676076853757Disabling writes for close at 1676076853757Writing region close event to WAL at 1676076853757Closed at 1676076853757 2023-02-11 00:54:13,757 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. after waiting 0 ms 2023-02-11 00:54:13,758 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:13,758 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:13,758 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 150784ae1670fd37287c48625f800672: Waiting for close lock at 1676076853757Disabling compacts and flushes for region at 1676076853757Disabling writes for close at 1676076853758 (+1 ms)Writing region close event to WAL at 1676076853758Closed at 1676076853758 2023-02-11 00:54:13,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:54:13,761 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676076853761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076853761"}]},"ts":"1676076853761"} 2023-02-11 00:54:13,761 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076853761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076853761"}]},"ts":"1676076853761"} 2023-02-11 00:54:13,762 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076853761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076853761"}]},"ts":"1676076853761"} 2023-02-11 00:54:13,764 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 00:54:13,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:54:13,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076853765"}]},"ts":"1676076853765"} 2023-02-11 00:54:13,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-11 00:54:13,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=150784ae1670fd37287c48625f800672, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d42d4a3686689b68f0a67d076f2a5669, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ae39e54d1127650946f335a6cc7dd55, ASSIGN}] 2023-02-11 00:54:13,772 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ae39e54d1127650946f335a6cc7dd55, ASSIGN 2023-02-11 00:54:13,772 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d42d4a3686689b68f0a67d076f2a5669, ASSIGN 2023-02-11 00:54:13,773 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=150784ae1670fd37287c48625f800672, ASSIGN 2023-02-11 00:54:13,773 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=150784ae1670fd37287c48625f800672, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:13,773 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d42d4a3686689b68f0a67d076f2a5669, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:13,773 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ae39e54d1127650946f335a6cc7dd55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:13,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=150784ae1670fd37287c48625f800672, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:13,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d42d4a3686689b68f0a67d076f2a5669, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:13,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2ae39e54d1127650946f335a6cc7dd55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:13,926 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076853925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076853925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076853925"}]},"ts":"1676076853925"} 2023-02-11 00:54:13,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076853925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076853925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076853925"}]},"ts":"1676076853925"} 2023-02-11 00:54:13,926 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676076853925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076853925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076853925"}]},"ts":"1676076853925"} 2023-02-11 00:54:13,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 150784ae1670fd37287c48625f800672, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:13,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 2ae39e54d1127650946f335a6cc7dd55, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:13,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure d42d4a3686689b68f0a67d076f2a5669, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:14,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:14,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:14,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 150784ae1670fd37287c48625f800672, NAME => 'testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 00:54:14,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:14,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,086 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,088 DEBUG [StoreOpener-150784ae1670fd37287c48625f800672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/family1 2023-02-11 00:54:14,088 DEBUG [StoreOpener-150784ae1670fd37287c48625f800672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/family1 2023-02-11 00:54:14,088 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 150784ae1670fd37287c48625f800672 columnFamilyName family1 2023-02-11 00:54:14,090 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] regionserver.HStore(310): Store=150784ae1670fd37287c48625f800672/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,091 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,093 DEBUG [StoreOpener-150784ae1670fd37287c48625f800672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/family2 2023-02-11 00:54:14,093 DEBUG [StoreOpener-150784ae1670fd37287c48625f800672-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/family2 2023-02-11 00:54:14,094 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 150784ae1670fd37287c48625f800672 columnFamilyName family2 2023-02-11 00:54:14,095 INFO [StoreOpener-150784ae1670fd37287c48625f800672-1] regionserver.HStore(310): Store=150784ae1670fd37287c48625f800672/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:54:14,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 150784ae1670fd37287c48625f800672 2023-02-11 00:54:14,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:14,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 150784ae1670fd37287c48625f800672; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58970764, jitterRate=-0.12126713991165161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:54:14,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 150784ae1670fd37287c48625f800672: Running coprocessor pre-open hook at 1676076854085Writing region info on filesystem at 1676076854085Initializing all the Stores at 1676076854086 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854086Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854086Cleaning up temporary data from old regions at 1676076854098 (+12 ms)Cleaning up detritus from prior splits at 1676076854098Running coprocessor post-open hooks at 1676076854105 (+7 ms)Region opened successfully at 1676076854105 2023-02-11 00:54:14,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672., pid=31, masterSystemTime=1676076854080 2023-02-11 00:54:14,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:14,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:14,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:14,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2ae39e54d1127650946f335a6cc7dd55, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 00:54:14,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,109 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=150784ae1670fd37287c48625f800672, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:14,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:14,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,109 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076854108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076854108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076854108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076854108"}]},"ts":"1676076854108"} 2023-02-11 00:54:14,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,112 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-11 00:54:14,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 150784ae1670fd37287c48625f800672, server=jenkins-hbase4.apache.org,43697,1676076813915 in 184 msec 2023-02-11 00:54:14,115 DEBUG [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1 2023-02-11 00:54:14,115 DEBUG [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1 2023-02-11 00:54:14,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=150784ae1670fd37287c48625f800672, ASSIGN in 344 msec 2023-02-11 00:54:14,115 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ae39e54d1127650946f335a6cc7dd55 columnFamilyName family1 2023-02-11 00:54:14,116 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] regionserver.HStore(310): Store=2ae39e54d1127650946f335a6cc7dd55/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,116 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,118 DEBUG [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family2 2023-02-11 00:54:14,118 DEBUG [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family2 2023-02-11 00:54:14,119 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ae39e54d1127650946f335a6cc7dd55 columnFamilyName family2 2023-02-11 00:54:14,119 INFO [StoreOpener-2ae39e54d1127650946f335a6cc7dd55-1] regionserver.HStore(310): Store=2ae39e54d1127650946f335a6cc7dd55/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:54:14,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:54:14,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:14,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2ae39e54d1127650946f335a6cc7dd55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60333637, jitterRate=-0.10095874965190887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:54:14,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2ae39e54d1127650946f335a6cc7dd55: Running coprocessor pre-open hook at 1676076854109Writing region info on filesystem at 1676076854109Initializing all the Stores at 1676076854110 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854111 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854112 (+1 ms)Cleaning up temporary data from old regions at 1676076854121 (+9 ms)Cleaning up detritus from prior splits at 1676076854121Running coprocessor post-open hooks at 1676076854126 (+5 ms)Region opened successfully at 1676076854126 2023-02-11 00:54:14,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55., pid=32, masterSystemTime=1676076854080 2023-02-11 00:54:14,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:14,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:14,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:14,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d42d4a3686689b68f0a67d076f2a5669, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 00:54:14,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2ae39e54d1127650946f335a6cc7dd55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:14,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:14,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676076854129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076854129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076854129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076854129"}]},"ts":"1676076854129"} 2023-02-11 00:54:14,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,130 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,132 DEBUG [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/family1 2023-02-11 00:54:14,132 DEBUG [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/family1 2023-02-11 00:54:14,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-11 00:54:14,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 2ae39e54d1127650946f335a6cc7dd55, server=jenkins-hbase4.apache.org,43697,1676076813915 in 202 msec 2023-02-11 00:54:14,132 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d42d4a3686689b68f0a67d076f2a5669 columnFamilyName family1 2023-02-11 00:54:14,133 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] regionserver.HStore(310): Store=d42d4a3686689b68f0a67d076f2a5669/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,134 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ae39e54d1127650946f335a6cc7dd55, ASSIGN in 361 msec 2023-02-11 00:54:14,135 DEBUG [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/family2 2023-02-11 00:54:14,135 DEBUG [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/family2 2023-02-11 00:54:14,135 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d42d4a3686689b68f0a67d076f2a5669 columnFamilyName family2 2023-02-11 00:54:14,136 INFO [StoreOpener-d42d4a3686689b68f0a67d076f2a5669-1] regionserver.HStore(310): Store=d42d4a3686689b68f0a67d076f2a5669/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:54:14,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:54:14,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:14,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d42d4a3686689b68f0a67d076f2a5669; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74771413, jitterRate=0.11418087780475616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:54:14,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d42d4a3686689b68f0a67d076f2a5669: Running coprocessor pre-open hook at 1676076854129Writing region info on filesystem at 1676076854129Initializing all the Stores at 1676076854130 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854130Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076854130Cleaning up temporary data from old regions at 1676076854138 (+8 ms)Cleaning up detritus from prior splits at 1676076854138Running coprocessor post-open hooks at 1676076854145 (+7 ms)Region opened successfully at 1676076854145 2023-02-11 00:54:14,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669., pid=33, masterSystemTime=1676076854080 2023-02-11 00:54:14,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:14,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:14,147 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d42d4a3686689b68f0a67d076f2a5669, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:14,148 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676076854147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076854147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076854147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076854147"}]},"ts":"1676076854147"} 2023-02-11 00:54:14,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-02-11 00:54:14,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure d42d4a3686689b68f0a67d076f2a5669, server=jenkins-hbase4.apache.org,43697,1676076813915 in 220 msec 2023-02-11 00:54:14,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-11 00:54:14,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d42d4a3686689b68f0a67d076f2a5669, ASSIGN in 380 msec 2023-02-11 00:54:14,153 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:54:14,154 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076854154"}]},"ts":"1676076854154"} 2023-02-11 00:54:14,155 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-11 00:54:14,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:54:14,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2450 sec 2023-02-11 00:54:15,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 00:54:15,026 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-11 00:54:15,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:15,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,034 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 00:54:15,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:15,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 00:54:15,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 00:54:15,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,036 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:15,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:15,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 00:54:15,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:15,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. started... 2023-02-11 00:54:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:54:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d42d4a3686689b68f0a67d076f2a5669: 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. started... 2023-02-11 00:54:15,038 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. started... 2023-02-11 00:54:15,039 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 150784ae1670fd37287c48625f800672: 2023-02-11 00:54:15,039 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2ae39e54d1127650946f335a6cc7dd55 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-11 00:54:15,039 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:15,039 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:54:15,453 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211973b744d10e14e05806f06fa7e529fe0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211973b744d10e14e05806f06fa7e529fe0 2023-02-11 00:54:15,866 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp/family1/8fff7fa688824bceb8175d6c048d5e39 2023-02-11 00:54:15,872 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp/family1/8fff7fa688824bceb8175d6c048d5e39 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39 2023-02-11 00:54:15,876 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 00:54:15,877 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2ae39e54d1127650946f335a6cc7dd55 in 838ms, sequenceid=5, compaction requested=false 2023-02-11 00:54:15,877 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-11 00:54:15,877 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2ae39e54d1127650946f335a6cc7dd55: 2023-02-11 00:54:15,878 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:54:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:54:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 00:54:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 00:54:15,879 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,879 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:15,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 00:54:15,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c90541[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:15,881 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 00:54:15,881 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,883 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,883 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 00:54:15,883 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 00:54:15,883 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,883 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:15,883 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:15,889 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 00:54:15,889 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,889 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:15,889 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 00:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:15,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 00:54:15,892 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 00:54:15,892 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:15,892 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:15,892 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,892 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:15,893 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,893 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:15,894 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,894 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:15,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,895 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,900 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,900 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:15,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:15,900 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:15,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 00:54:15,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:15,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-11 00:54:15,900 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:15,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,001 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:16,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:16,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:16,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:16,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,009 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 00:54:16,009 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:16,009 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 00:54:16,009 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 00:54:16,009 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,009 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,011 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:16,011 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,013 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,013 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:16,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:16,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:16,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-11 00:54:16,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,017 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 00:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:16,018 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. started... 2023-02-11 00:54:16,020 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d42d4a3686689b68f0a67d076f2a5669: 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. started... 2023-02-11 00:54:16,020 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:16,020 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2ae39e54d1127650946f335a6cc7dd55 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. started... 2023-02-11 00:54:16,020 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 150784ae1670fd37287c48625f800672: 2023-02-11 00:54:16,020 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:54:16,020 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:54:16,436 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211745cb3d7b8cc47a5a210bf9e0ea92766 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211745cb3d7b8cc47a5a210bf9e0ea92766 2023-02-11 00:54:16,842 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp/family1/f822ca3bf108451e83b6ddd30a1e934e 2023-02-11 00:54:16,846 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp/family1/f822ca3bf108451e83b6ddd30a1e934e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e 2023-02-11 00:54:16,850 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e, entries=2, sequenceid=9, filesize=5.0 K 2023-02-11 00:54:16,851 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2ae39e54d1127650946f335a6cc7dd55 in 831ms, sequenceid=9, compaction requested=false 2023-02-11 00:54:16,852 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2ae39e54d1127650946f335a6cc7dd55: 2023-02-11 00:54:16,852 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:16,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:54:16,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:54:16,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 00:54:16,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 00:54:16,853 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:16,854 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,854 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:16,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 00:54:16,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36e17ea4[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:16,855 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 00:54:16,855 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,856 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 00:54:16,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 00:54:16,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:16,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:16,859 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 00:54:16,859 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,859 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,859 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 00:54:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 00:54:16,862 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 00:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:16,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,862 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:16,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:16,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:16,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:16,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:16,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:16,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 00:54:16,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:16,867 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:16,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:16,868 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:16,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,968 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:16,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:16,975 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-11 00:54:16,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 00:54:16,977 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 00:54:16,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:16,978 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077456978 2023-02-11 00:54:16,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:16,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-11 00:54:16,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 00:54:16,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x56c675a8 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:16,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eaf00bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:16,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 00:54:17,816 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021196bc24e24b904d5288627c7082646b44 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021196bc24e24b904d5288627c7082646b44 2023-02-11 00:54:17,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 00:54:17,835 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:17,836 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56908, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:17,848 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:17,850 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:17,865 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/256da8ab40da494d9d0602be8b3208ec first=Optional[k0] last=Optional[k1] 2023-02-11 00:54:17,866 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/256da8ab40da494d9d0602be8b3208ec}] 2023-02-11 00:54:17,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/256da8ab40da494d9d0602be8b3208ec for inclusion in 2ae39e54d1127650946f335a6cc7dd55/family1 2023-02-11 00:54:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-11 00:54:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 00:54:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 2ae39e54d1127650946f335a6cc7dd55: 2023-02-11 00:54:17,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/256da8ab40da494d9d0602be8b3208ec to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testScannerOnBulkLoadRefHFiles__bp10nb5nsgpa8ckrurlflkurhm4j7qgakkga8ugh0v84kn28gqeoh1vn813304hb/family1/256da8ab40da494d9d0602be8b3208ec 2023-02-11 00:54:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testScannerOnBulkLoadRefHFiles__bp10nb5nsgpa8ckrurlflkurhm4j7qgakkga8ugh0v84kn28gqeoh1vn813304hb/family1/256da8ab40da494d9d0602be8b3208ec as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_ 2023-02-11 00:54:17,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testScannerOnBulkLoadRefHFiles__bp10nb5nsgpa8ckrurlflkurhm4j7qgakkga8ugh0v84kn28gqeoh1vn813304hb/family1/256da8ab40da494d9d0602be8b3208ec into 2ae39e54d1127650946f335a6cc7dd55/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_ - updating store file list. 2023-02-11 00:54:17,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_ into 2ae39e54d1127650946f335a6cc7dd55/family1 2023-02-11 00:54:17,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testScannerOnBulkLoadRefHFiles__bp10nb5nsgpa8ckrurlflkurhm4j7qgakkga8ugh0v84kn28gqeoh1vn813304hb/family1/256da8ab40da494d9d0602be8b3208ec into 2ae39e54d1127650946f335a6cc7dd55/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_) 2023-02-11 00:54:17,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testScannerOnBulkLoadRefHFiles__bp10nb5nsgpa8ckrurlflkurhm4j7qgakkga8ugh0v84kn28gqeoh1vn813304hb/family1/256da8ab40da494d9d0602be8b3208ec 2023-02-11 00:54:17,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:54:17,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:54:17,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 2ae39e54d1127650946f335a6cc7dd55/family1 is initiating minor compaction (all files) 2023-02-11 00:54:17,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c2c51bc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:17,892 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2ae39e54d1127650946f335a6cc7dd55/family1 in testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:54:17,892 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp, totalSize=15.1 K 2023-02-11 00:54:17,892 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 8fff7fa688824bceb8175d6c048d5e39, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076855026 2023-02-11 00:54:17,893 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting f822ca3bf108451e83b6ddd30a1e934e, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076855026 2023-02-11 00:54:17,893 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 3502e8836a614e13a612875d230b1d1d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076855026 2023-02-11 00:54:17,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 00:54:17,895 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:17,897 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211745cb3d7b8cc47a5a210bf9e0ea92766 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211745cb3d7b8cc47a5a210bf9e0ea92766 2023-02-11 00:54:17,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211973b744d10e14e05806f06fa7e529fe0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211973b744d10e14e05806f06fa7e529fe0 2023-02-11 00:54:17,898 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-11 00:54:17,898 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 00:54:17,899 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 00:54:17,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 00:54:17,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:17,900 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 00:54:17,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 925 msec 2023-02-11 00:54:17,905 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2ae39e54d1127650946f335a6cc7dd55#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:17,937 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 253), OpenFileDescriptor=593 (was 598), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 209), ProcessCount=168 (was 168), AvailableMemoryMB=3273 (was 3352) 2023-02-11 00:54:17,948 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=168, AvailableMemoryMB=3273 2023-02-11 00:54:17,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:54:17,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:17,952 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:54:17,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-11 00:54:17,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:54:17,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:17,954 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:17,955 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc empty. 2023-02-11 00:54:17,955 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:17,955 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-11 00:54:18,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:18,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:18,363 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:18,366 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 042a93d7715004fb92e348c1e093dcfc, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:18,730 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/.tmp/family1/5dca80fab4284a8eae2554f96b00f51f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/5dca80fab4284a8eae2554f96b00f51f 2023-02-11 00:54:18,743 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2ae39e54d1127650946f335a6cc7dd55/family1 of 2ae39e54d1127650946f335a6cc7dd55 into 5dca80fab4284a8eae2554f96b00f51f(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:18,744 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2ae39e54d1127650946f335a6cc7dd55: 2023-02-11 00:54:18,744 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676076857891; duration=0sec 2023-02-11 00:54:18,744 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 042a93d7715004fb92e348c1e093dcfc, disabling compactions & flushes 2023-02-11 00:54:18,777 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. after waiting 0 ms 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:18,777 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:18,777 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 042a93d7715004fb92e348c1e093dcfc: Waiting for close lock at 1676076858777Disabling compacts and flushes for region at 1676076858777Disabling writes for close at 1676076858777Writing region close event to WAL at 1676076858777Closed at 1676076858777 2023-02-11 00:54:18,779 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:54:18,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_] to archive 2023-02-11 00:54:18,784 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076858783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076858783"}]},"ts":"1676076858783"} 2023-02-11 00:54:18,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:18,785 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:54:18,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:54:18,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/8fff7fa688824bceb8175d6c048d5e39 2023-02-11 00:54:18,786 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076858786"}]},"ts":"1676076858786"} 2023-02-11 00:54:18,788 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 00:54:18,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/f822ca3bf108451e83b6ddd30a1e934e 2023-02-11 00:54:18,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/family1/3502e8836a614e13a612875d230b1d1d_SeqId_12_ 2023-02-11 00:54:18,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=042a93d7715004fb92e348c1e093dcfc, ASSIGN}] 2023-02-11 00:54:18,793 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=042a93d7715004fb92e348c1e093dcfc, ASSIGN 2023-02-11 00:54:18,794 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=042a93d7715004fb92e348c1e093dcfc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:18,945 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=042a93d7715004fb92e348c1e093dcfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:18,945 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076858945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076858945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076858945"}]},"ts":"1676076858945"} 2023-02-11 00:54:18,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 042a93d7715004fb92e348c1e093dcfc, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:19,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:19,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 042a93d7715004fb92e348c1e093dcfc, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,103 INFO [StoreOpener-042a93d7715004fb92e348c1e093dcfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,104 DEBUG [StoreOpener-042a93d7715004fb92e348c1e093dcfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:19,105 DEBUG [StoreOpener-042a93d7715004fb92e348c1e093dcfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:19,105 INFO [StoreOpener-042a93d7715004fb92e348c1e093dcfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 042a93d7715004fb92e348c1e093dcfc columnFamilyName family1 2023-02-11 00:54:19,106 INFO [StoreOpener-042a93d7715004fb92e348c1e093dcfc-1] regionserver.HStore(310): Store=042a93d7715004fb92e348c1e093dcfc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:19,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:54:19,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:19,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 042a93d7715004fb92e348c1e093dcfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59278033, jitterRate=-0.11668847501277924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:19,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 042a93d7715004fb92e348c1e093dcfc: Running coprocessor pre-open hook at 1676076859102Writing region info on filesystem at 1676076859102Initializing all the Stores at 1676076859103 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076859103Cleaning up temporary data from old regions at 1676076859108 (+5 ms)Cleaning up detritus from prior splits at 1676076859108Running coprocessor post-open hooks at 1676076859112 (+4 ms)Region opened successfully at 1676076859112 2023-02-11 00:54:19,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc., pid=37, masterSystemTime=1676076859098 2023-02-11 00:54:19,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:19,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:19,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=042a93d7715004fb92e348c1e093dcfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:19,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676076859115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076859115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076859115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076859115"}]},"ts":"1676076859115"} 2023-02-11 00:54:19,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-11 00:54:19,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 042a93d7715004fb92e348c1e093dcfc, server=jenkins-hbase4.apache.org,43697,1676076813915 in 170 msec 2023-02-11 00:54:19,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-11 00:54:19,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=042a93d7715004fb92e348c1e093dcfc, ASSIGN in 326 msec 2023-02-11 00:54:19,120 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:54:19,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076859120"}]},"ts":"1676076859120"} 2023-02-11 00:54:19,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 00:54:19,123 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:54:19,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1730 sec 2023-02-11 00:54:19,613 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:54:20,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 00:54:20,059 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-11 00:54:20,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,087 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:20,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:20,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:20,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:20,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:20,089 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:20,089 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,089 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:20,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:20,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:20,090 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:20,090 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:20,091 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:54:20,512 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130be1c49c603b1472983277ec0d6ea733d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130be1c49c603b1472983277ec0d6ea733d 2023-02-11 00:54:20,916 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/c45e7fcf33004f09b29e311dc8b52bf9 2023-02-11 00:54:20,921 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/c45e7fcf33004f09b29e311dc8b52bf9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9 2023-02-11 00:54:20,925 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 00:54:20,926 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 835ms, sequenceid=5, compaction requested=false 2023-02-11 00:54:20,926 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:20,926 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:20,927 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:20,927 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:20,927 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:20,927 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,927 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:20,927 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,928 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:20,929 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,929 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:20,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:20,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d2eb5d5[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:20,930 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:20,930 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,932 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:20,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:20,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:20,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:20,934 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:20,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:20,936 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:20,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:20,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:20,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,936 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:20,937 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,937 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:20,937 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:20,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:20,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,939 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,941 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,941 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:20,941 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:20,942 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:20,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:20,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:20,942 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:20,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:21,042 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:21,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:21,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:21,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,049 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:21,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:21,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:21,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:21,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,049 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,052 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,052 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:21,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:21,052 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,052 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,053 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,053 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:21,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,053 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:21,053 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:21,053 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:21,054 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:21,054 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:21,054 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:21,054 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:21,054 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:54:21,468 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128892ad38d618d45148cce5cb2f34d952b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128892ad38d618d45148cce5cb2f34d952b 2023-02-11 00:54:21,874 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/9607b8425a254b0c8c3c9d23bb72d6cc 2023-02-11 00:54:21,879 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/9607b8425a254b0c8c3c9d23bb72d6cc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc 2023-02-11 00:54:21,883 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:54:21,884 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 830ms, sequenceid=9, compaction requested=false 2023-02-11 00:54:21,884 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:21,884 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:21,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,886 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:21,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:21,886 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,887 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c91f0f5[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:21,888 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:21,888 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,895 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:21,895 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,895 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:21,897 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:21,897 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:21,899 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:21,899 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:21,899 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:21,899 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,899 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:21,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:21,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,901 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:21,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,902 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:21,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:21,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:21,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:21,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:21,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:21,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:21,905 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:21,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:21,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:22,005 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:22,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:22,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:22,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:22,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,011 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:22,011 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:22,012 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:22,012 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:22,012 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,012 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,014 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:22,014 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:22,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:22,015 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,015 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:22,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:22,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:22,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:22,016 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:22,016 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:22,016 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:22,016 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:22,431 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011786debce9344a868cbc4940e404d8ca to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011786debce9344a868cbc4940e404d8ca 2023-02-11 00:54:22,837 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/f6e6abc471604552a2f23c76dd7d0c06 2023-02-11 00:54:22,842 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/f6e6abc471604552a2f23c76dd7d0c06 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06 2023-02-11 00:54:22,846 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 00:54:22,847 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 831ms, sequenceid=13, compaction requested=true 2023-02-11 00:54:22,847 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:22,847 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:22,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:22,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:22,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:22,847 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:22,849 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,849 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:22,849 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,849 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:22,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:22,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:22,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@455b132b[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:22,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:22,851 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,852 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:22,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:22,852 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,852 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:22,854 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,854 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:22,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:22,854 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:22,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:22,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:22,857 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:22,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:22,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:22,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,857 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:22,862 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,862 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:22,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,862 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:22,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:22,863 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:22,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:22,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,866 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:22,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:22,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:22,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:22,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:22,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:22,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:22,867 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:22,967 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:22,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:22,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:22,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:22,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,974 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:22,974 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:22,974 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:22,974 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:22,974 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,974 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,975 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,975 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:22,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:22,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:22,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:22,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:22,977 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:22,977 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:22,977 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:22,977 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:22,977 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:22,977 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:22,977 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:22,977 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:23,395 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cb314336e6374cd5ac4d2e2245f51949 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb314336e6374cd5ac4d2e2245f51949 2023-02-11 00:54:23,801 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/fe3a0a7eacf3459b98b4b7c46745841d 2023-02-11 00:54:23,805 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/fe3a0a7eacf3459b98b4b7c46745841d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d 2023-02-11 00:54:23,809 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 00:54:23,810 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 833ms, sequenceid=17, compaction requested=true 2023-02-11 00:54:23,810 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:23,810 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:23,810 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:23,810 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:23,810 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,810 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:23,810 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:23,812 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:23,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:23,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f2517a[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:23,814 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:23,814 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,815 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:23,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:23,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:23,815 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,815 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:23,817 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:23,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:23,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:23,820 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:23,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:23,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:23,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,820 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:23,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:23,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:23,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:23,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:23,826 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,827 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:23,829 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:23,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:23,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:23,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:23,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:23,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:23,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:23,830 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,830 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,830 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,830 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:23,830 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:23,930 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:23,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:23,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:23,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:23,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,936 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:23,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:23,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:23,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:23,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,936 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,938 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:23,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:23,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:23,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:23,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:23,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:23,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:23,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:23,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:23,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:23,939 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:24,352 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282a40ca91e660460e813818c6d5ef0024 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282a40ca91e660460e813818c6d5ef0024 2023-02-11 00:54:24,604 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:54:24,758 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/8aff5ad5e60447c3932f621c0a278dba 2023-02-11 00:54:24,763 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/8aff5ad5e60447c3932f621c0a278dba as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba 2023-02-11 00:54:24,766 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 00:54:24,767 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 828ms, sequenceid=21, compaction requested=true 2023-02-11 00:54:24,767 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:24,767 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:24,767 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:24,776 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:24,778 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@109ad3ac[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:24,778 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,779 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,779 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:24,779 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,779 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:24,779 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:24,780 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:24,781 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:24,781 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,781 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:24,781 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:24,786 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:24,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:24,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:24,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,786 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:24,787 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,787 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,788 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:24,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:24,788 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:24,789 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:24,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:24,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:24,793 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,793 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:24,794 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:24,794 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:24,794 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:24,794 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:24,794 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:24,894 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:24,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:24,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:24,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:24,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,900 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:24,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:24,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:24,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:24,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,900 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,902 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:24,902 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:24,902 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:24,902 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:24,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:24,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:24,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:24,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:24,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:24,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:24,903 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:24,903 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:24,903 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:25,316 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bd12563c9a814cf98e12370f2ecc2702 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd12563c9a814cf98e12370f2ecc2702 2023-02-11 00:54:25,721 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/d0f72850f8464fe8b99d13ed75858fe9 2023-02-11 00:54:25,726 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/d0f72850f8464fe8b99d13ed75858fe9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9 2023-02-11 00:54:25,731 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 00:54:25,732 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 829ms, sequenceid=25, compaction requested=true 2023-02-11 00:54:25,732 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:25,732 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:25,739 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,739 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:25,740 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:25,740 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:25,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@736f9f12[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:25,742 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:25,742 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,743 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,743 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:25,743 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:25,743 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:25,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,744 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:25,746 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:25,746 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,747 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:25,747 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:25,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:25,750 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:25,750 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:25,750 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:25,750 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,750 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:25,752 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,752 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,752 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:25,753 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,754 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,756 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,756 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:25,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:25,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:25,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:25,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:25,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:25,756 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:25,756 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,757 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,857 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:25,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:25,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:25,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:25,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,864 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:25,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:25,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:25,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:25,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,865 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:25,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:25,866 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:25,866 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,867 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:25,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:25,867 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:25,867 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:25,867 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:26,280 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010587cab04e904a7487d2c3f7388c74cc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601010587cab04e904a7487d2c3f7388c74cc 2023-02-11 00:54:26,687 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/7d888f6bee204d119dd8b001cb7b258d 2023-02-11 00:54:26,693 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/7d888f6bee204d119dd8b001cb7b258d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d 2023-02-11 00:54:26,697 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 00:54:26,698 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 831ms, sequenceid=29, compaction requested=true 2023-02-11 00:54:26,698 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:26,698 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:26,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:26,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:26,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:26,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:26,700 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,700 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:26,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:26,700 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,700 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:26,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:26,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:26,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:26,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:26,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e30081f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:26,702 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:26,702 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,703 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,703 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:26,703 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:26,704 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:26,704 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,704 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:26,706 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,706 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:26,706 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:26,706 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:26,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:26,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:26,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:26,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:26,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:26,708 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:26,708 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:26,709 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:26,709 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,709 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:26,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:26,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:26,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:26,711 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:26,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:26,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:26,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:26,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:26,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:26,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:26,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,815 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:26,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:26,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:26,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:26,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,822 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:26,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:26,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:26,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:26,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,826 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:26,826 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:26,827 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:26,827 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,828 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,828 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:26,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:26,828 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:26,828 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:26,828 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:26,842 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c92835c926a64f4187adf92d395638bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c92835c926a64f4187adf92d395638bc 2023-02-11 00:54:27,247 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/d9871de06b33465996da03174e130c6e 2023-02-11 00:54:27,252 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/d9871de06b33465996da03174e130c6e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e 2023-02-11 00:54:27,255 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 00:54:27,256 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 428ms, sequenceid=33, compaction requested=true 2023-02-11 00:54:27,256 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:27,256 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:27,256 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:27,256 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:27,256 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:27,257 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:27,258 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:27,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@423fd22[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:27,260 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:27,260 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,261 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:27,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:27,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:27,265 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,265 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:27,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:27,267 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:27,267 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:27,267 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:27,267 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,267 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:27,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:27,269 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,270 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:27,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:27,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:27,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,273 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:27,274 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:27,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:27,374 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:27,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:27,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:27,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:27,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,388 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:27,388 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:27,388 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:27,388 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:27,389 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,389 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,390 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:27,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:27,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,392 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:27,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:27,395 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,395 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:27,396 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:27,396 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:27,396 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:27,396 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:27,397 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:27,433 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090755682e835b234f61886127ffc9aa05c6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090755682e835b234f61886127ffc9aa05c6 2023-02-11 00:54:27,843 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/829f17f512fe4aef84db0cf867462648 2023-02-11 00:54:27,848 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/829f17f512fe4aef84db0cf867462648 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648 2023-02-11 00:54:27,852 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 00:54:27,853 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 457ms, sequenceid=37, compaction requested=true 2023-02-11 00:54:27,853 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:27,853 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:27,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,856 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,856 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:27,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:27,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42e249b9[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:27,857 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,858 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:27,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:27,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:27,858 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,858 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:27,859 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,859 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,860 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:27,860 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:27,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:27,862 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:27,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:27,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:27,862 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,862 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:27,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,863 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:27,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:27,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:27,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,865 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:27,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:27,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:27,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,868 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:27,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:27,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:27,868 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,969 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:27,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:27,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:27,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:27,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,976 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:27,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:27,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 00:54:27,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 00:54:27,976 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,977 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,978 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:27,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:27,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:27,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,980 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 00:54:27,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 00:54:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 00:54:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:27,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:27,980 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:27,980 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. started... 2023-02-11 00:54:27,980 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 042a93d7715004fb92e348c1e093dcfc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:28,395 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206ff40da6c830440abf75173189dac1f4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511206ff40da6c830440abf75173189dac1f4 2023-02-11 00:54:28,803 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/81f25b9831134356a8526b6d286473f4 2023-02-11 00:54:28,808 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/81f25b9831134356a8526b6d286473f4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4 2023-02-11 00:54:28,812 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 00:54:28,813 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 042a93d7715004fb92e348c1e093dcfc in 833ms, sequenceid=41, compaction requested=true 2023-02-11 00:54:28,813 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:28,813 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:28,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:28,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:28,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 00:54:28,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 00:54:28,815 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:28,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,815 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:28,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 00:54:28,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dfac9f8[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:28,817 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 00:54:28,817 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,818 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 00:54:28,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 00:54:28,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:28,819 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,819 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:28,821 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 00:54:28,821 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:28,821 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,821 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 00:54:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:28,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:54:28,823 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 00:54:28,823 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:28,823 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:28,823 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,823 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:28,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:28,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:28,825 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:28,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,826 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:28,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 00:54:28,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:28,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:28,832 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,833 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,833 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:28,833 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:28,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:28,933 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:28,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:28,935 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-11 00:54:28,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:28,937 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:28,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:28,938 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077468938 2023-02-11 00:54:28,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:28,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 00:54:28,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:28,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x68bc3207 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:28,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3053a733, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:28,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,794 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034c5bcf6649f848e5884700120996879f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601034c5bcf6649f848e5884700120996879f 2023-02-11 00:54:29,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:29,807 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:29,809 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:29,815 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:29,816 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:29,824 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99c73e21ff0e449b8badfd65726076c7 first=Optional[r3] last=Optional[r6] 2023-02-11 00:54:29,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99c73e21ff0e449b8badfd65726076c7}] 2023-02-11 00:54:29,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99c73e21ff0e449b8badfd65726076c7 for inclusion in 042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 00:54:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:29,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99c73e21ff0e449b8badfd65726076c7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4dgbsq4p4hpmfg7knk8a9spe67ink88g68e7235197mi6foheb3rgav9takvpp3v/family1/99c73e21ff0e449b8badfd65726076c7 2023-02-11 00:54:29,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4dgbsq4p4hpmfg7knk8a9spe67ink88g68e7235197mi6foheb3rgav9takvpp3v/family1/99c73e21ff0e449b8badfd65726076c7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_ 2023-02-11 00:54:29,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4dgbsq4p4hpmfg7knk8a9spe67ink88g68e7235197mi6foheb3rgav9takvpp3v/family1/99c73e21ff0e449b8badfd65726076c7 into 042a93d7715004fb92e348c1e093dcfc/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_ - updating store file list. 2023-02-11 00:54:29,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_ into 042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:29,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4dgbsq4p4hpmfg7knk8a9spe67ink88g68e7235197mi6foheb3rgav9takvpp3v/family1/99c73e21ff0e449b8badfd65726076c7 into 042a93d7715004fb92e348c1e093dcfc/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_) 2023-02-11 00:54:29,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4dgbsq4p4hpmfg7knk8a9spe67ink88g68e7235197mi6foheb3rgav9takvpp3v/family1/99c73e21ff0e449b8badfd65726076c7 2023-02-11 00:54:29,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:54:29,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:54:29,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 042a93d7715004fb92e348c1e093dcfc/family1 is initiating minor compaction 2023-02-11 00:54:29,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@345145b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:29,841 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 042a93d7715004fb92e348c1e093dcfc/family1 in testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:29,841 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp, totalSize=50.0 K 2023-02-11 00:54:29,841 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 9607b8425a254b0c8c3c9d23bb72d6cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:54:29,841 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting f6e6abc471604552a2f23c76dd7d0c06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:54:29,841 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting fe3a0a7eacf3459b98b4b7c46745841d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:54:29,841 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 8aff5ad5e60447c3932f621c0a278dba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting d0f72850f8464fe8b99d13ed75858fe9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 7d888f6bee204d119dd8b001cb7b258d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting d9871de06b33465996da03174e130c6e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 829f17f512fe4aef84db0cf867462648, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 81f25b9831134356a8526b6d286473f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:54:29,842 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting e2a63a4a714343f18163263168701a88_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:54:29,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:29,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:29,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282a40ca91e660460e813818c6d5ef0024 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282a40ca91e660460e813818c6d5ef0024 2023-02-11 00:54:29,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd12563c9a814cf98e12370f2ecc2702 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd12563c9a814cf98e12370f2ecc2702 2023-02-11 00:54:29,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601010587cab04e904a7487d2c3f7388c74cc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601010587cab04e904a7487d2c3f7388c74cc 2023-02-11 00:54:29,850 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c92835c926a64f4187adf92d395638bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c92835c926a64f4187adf92d395638bc 2023-02-11 00:54:29,850 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 00:54:29,850 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 00:54:29,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:29,881 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 042a93d7715004fb92e348c1e093dcfc#family1#compaction#48 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:30,696 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/e9d29104b24248aa89d786908c2413e6 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e9d29104b24248aa89d786908c2413e6 2023-02-11 00:54:30,701 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 042a93d7715004fb92e348c1e093dcfc/family1 of 042a93d7715004fb92e348c1e093dcfc into e9d29104b24248aa89d786908c2413e6(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:30,701 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:30,702 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676076869841; duration=0sec 2023-02-11 00:54:30,702 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:30,708 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fcbae1f96e9e4cafbb9ebdd9f4aa4a12 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcbae1f96e9e4cafbb9ebdd9f4aa4a12 2023-02-11 00:54:30,709 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:30,733 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b first=Optional[r00] last=Optional[r2] 2023-02-11 00:54:30,733 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b}] 2023-02-11 00:54:30,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b for inclusion in 042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:30,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 00:54:30,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:30,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:30,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ghppoc4588avnu5jaj9uigk4eqa6cgm8fbjldq0prukpi7hiek3oviqvb6j1cmb7/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b 2023-02-11 00:54:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ghppoc4588avnu5jaj9uigk4eqa6cgm8fbjldq0prukpi7hiek3oviqvb6j1cmb7/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_ 2023-02-11 00:54:30,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ghppoc4588avnu5jaj9uigk4eqa6cgm8fbjldq0prukpi7hiek3oviqvb6j1cmb7/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b into 042a93d7715004fb92e348c1e093dcfc/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_ - updating store file list. 2023-02-11 00:54:30,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_ into 042a93d7715004fb92e348c1e093dcfc/family1 2023-02-11 00:54:30,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ghppoc4588avnu5jaj9uigk4eqa6cgm8fbjldq0prukpi7hiek3oviqvb6j1cmb7/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b into 042a93d7715004fb92e348c1e093dcfc/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_) 2023-02-11 00:54:30,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ghppoc4588avnu5jaj9uigk4eqa6cgm8fbjldq0prukpi7hiek3oviqvb6j1cmb7/family1/ebc36c71ccb04fefb6bfaf30be9bdb9b 2023-02-11 00:54:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:54:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:54:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 042a93d7715004fb92e348c1e093dcfc/family1 is initiating minor compaction (all files) 2023-02-11 00:54:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@b0aaaff; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:30,747 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 042a93d7715004fb92e348c1e093dcfc/family1 in testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:54:30,747 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e9d29104b24248aa89d786908c2413e6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp, totalSize=337.0 K 2023-02-11 00:54:30,747 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c45e7fcf33004f09b29e311dc8b52bf9, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:54:30,748 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting e9d29104b24248aa89d786908c2413e6, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:54:30,748 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837900 2023-02-11 00:54:30,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:30,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:30,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130be1c49c603b1472983277ec0d6ea733d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130be1c49c603b1472983277ec0d6ea733d 2023-02-11 00:54:30,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011786debce9344a868cbc4940e404d8ca to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011786debce9344a868cbc4940e404d8ca 2023-02-11 00:54:30,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb314336e6374cd5ac4d2e2245f51949 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb314336e6374cd5ac4d2e2245f51949 2023-02-11 00:54:30,753 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-11 00:54:30,753 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 00:54:30,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 00:54:30,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 00:54:30,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:30,755 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:54:30,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8200 sec 2023-02-11 00:54:30,765 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 042a93d7715004fb92e348c1e093dcfc#family1#compaction#49 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:54:30,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_] to archive 2023-02-11 00:54:30,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:30,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/9607b8425a254b0c8c3c9d23bb72d6cc 2023-02-11 00:54:30,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/f6e6abc471604552a2f23c76dd7d0c06 2023-02-11 00:54:30,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe3a0a7eacf3459b98b4b7c46745841d 2023-02-11 00:54:30,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/8aff5ad5e60447c3932f621c0a278dba 2023-02-11 00:54:30,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d0f72850f8464fe8b99d13ed75858fe9 2023-02-11 00:54:30,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/7d888f6bee204d119dd8b001cb7b258d 2023-02-11 00:54:30,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/d9871de06b33465996da03174e130c6e 2023-02-11 00:54:30,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/829f17f512fe4aef84db0cf867462648 2023-02-11 00:54:30,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/81f25b9831134356a8526b6d286473f4 2023-02-11 00:54:30,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e2a63a4a714343f18163263168701a88_SeqId_44_ 2023-02-11 00:54:30,847 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264 (was 249) - Thread LEAK? -, OpenFileDescriptor=629 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 192) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3178 (was 3273) 2023-02-11 00:54:30,858 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=264, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=168, AvailableMemoryMB=3178 2023-02-11 00:54:30,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:54:30,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:30,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:54:30,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-11 00:54:30,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:54:30,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:30,865 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:30,865 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f empty. 2023-02-11 00:54:30,866 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:30,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-11 00:54:30,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:31,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:31,274 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:31,275 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4651ccd3f867fdf14b96e97db6fc4f5f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:31,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:31,588 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/.tmp/family1/fe94a089f826485f9f07ddeb0cf1f3e8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/fe94a089f826485f9f07ddeb0cf1f3e8 2023-02-11 00:54:31,593 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 042a93d7715004fb92e348c1e093dcfc/family1 of 042a93d7715004fb92e348c1e093dcfc into fe94a089f826485f9f07ddeb0cf1f3e8(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:31,593 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 042a93d7715004fb92e348c1e093dcfc: 2023-02-11 00:54:31,593 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676076870747; duration=0sec 2023-02-11 00:54:31,593 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:31,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e9d29104b24248aa89d786908c2413e6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_] to archive 2023-02-11 00:54:31,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:31,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/c45e7fcf33004f09b29e311dc8b52bf9 2023-02-11 00:54:31,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e9d29104b24248aa89d786908c2413e6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/e9d29104b24248aa89d786908c2413e6 2023-02-11 00:54:31,680 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:31,681 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 4651ccd3f867fdf14b96e97db6fc4f5f, disabling compactions & flushes 2023-02-11 00:54:31,681 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:31,681 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:31,681 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. after waiting 0 ms 2023-02-11 00:54:31,681 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:31,681 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:31,681 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Waiting for close lock at 1676076871681Disabling compacts and flushes for region at 1676076871681Disabling writes for close at 1676076871681Writing region close event to WAL at 1676076871681Closed at 1676076871681 2023-02-11 00:54:31,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/family1/b589aeb4f2114620be5ce5b4c14b252f_SeqId_47_ 2023-02-11 00:54:31,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:54:31,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076871683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076871683"}]},"ts":"1676076871683"} 2023-02-11 00:54:31,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:54:31,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:54:31,686 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076871686"}]},"ts":"1676076871686"} 2023-02-11 00:54:31,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-11 00:54:31,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, ASSIGN}] 2023-02-11 00:54:31,691 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, ASSIGN 2023-02-11 00:54:31,692 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:31,843 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:31,843 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076871843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076871843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076871843"}]},"ts":"1676076871843"} 2023-02-11 00:54:31,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:31,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:32,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4651ccd3f867fdf14b96e97db6fc4f5f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:32,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:32,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,001 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,003 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:32,003 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:32,003 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4651ccd3f867fdf14b96e97db6fc4f5f columnFamilyName family1 2023-02-11 00:54:32,004 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(310): Store=4651ccd3f867fdf14b96e97db6fc4f5f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:32,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:32,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:32,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4651ccd3f867fdf14b96e97db6fc4f5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63259909, jitterRate=-0.057353898882865906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:32,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Running coprocessor pre-open hook at 1676076872000Writing region info on filesystem at 1676076872000Initializing all the Stores at 1676076872001 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076872001Cleaning up temporary data from old regions at 1676076872006 (+5 ms)Cleaning up detritus from prior splits at 1676076872006Running coprocessor post-open hooks at 1676076872010 (+4 ms)Region opened successfully at 1676076872010 2023-02-11 00:54:32,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., pid=41, masterSystemTime=1676076871997 2023-02-11 00:54:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:32,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:32,013 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:32,013 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076872013"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076872013"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076872013"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076872013"}]},"ts":"1676076872013"} 2023-02-11 00:54:32,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-11 00:54:32,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 170 msec 2023-02-11 00:54:32,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-11 00:54:32,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, ASSIGN in 327 msec 2023-02-11 00:54:32,019 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:54:32,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076872019"}]},"ts":"1676076872019"} 2023-02-11 00:54:32,020 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-11 00:54:32,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:54:32,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1640 sec 2023-02-11 00:54:32,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 00:54:32,969 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-11 00:54:32,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:32,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,996 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:32,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:32,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:32,996 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:32,997 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,997 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,998 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:32,998 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:32,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:32,998 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:32,998 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:32,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:32,999 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:33,000 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:33,000 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:33,000 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:33,001 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:54:33,418 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113004da4e293b724e7cb447f4c43f629c84 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004da4e293b724e7cb447f4c43f629c84 2023-02-11 00:54:33,822 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/587364346fb348d3be63590605e75662 2023-02-11 00:54:33,827 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/587364346fb348d3be63590605e75662 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662 2023-02-11 00:54:33,831 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-11 00:54:33,832 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 832ms, sequenceid=5, compaction requested=false 2023-02-11 00:54:33,832 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:33,832 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:33,832 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:33,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:33,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:33,832 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,833 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:33,833 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:33,834 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,834 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:33,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:33,835 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,835 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:33,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:33,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:33,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:33,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:33,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@236440a8[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:33,836 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:33,836 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:33,837 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:33,838 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:33,838 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,838 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:33,840 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:33,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:33,842 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:33,842 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:33,842 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:33,842 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,842 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:33,844 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,844 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,844 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:33,844 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:33,845 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:33,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,847 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,847 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,847 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,847 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:33,848 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:33,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:33,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:33,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:33,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:33,848 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:33,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:33,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:33,948 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:33,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:33,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,954 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:33,954 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:33,954 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:33,954 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:33,955 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,955 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,957 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,957 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:33,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:33,957 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:33,957 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:33,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:33,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,958 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,958 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:33,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:33,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:33,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:33,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:33,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:33,958 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:33,958 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:33,958 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:33,958 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:54:34,370 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128766c0f9dc1a048fcb8894a569be3c863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128766c0f9dc1a048fcb8894a569be3c863 2023-02-11 00:54:34,776 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/bb4337ce72ca451ca8559e917e575af7 2023-02-11 00:54:34,781 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/bb4337ce72ca451ca8559e917e575af7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7 2023-02-11 00:54:34,785 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:54:34,786 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 828ms, sequenceid=9, compaction requested=false 2023-02-11 00:54:34,786 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:34,786 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:34,786 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:34,786 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:34,786 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,786 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:34,786 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:34,788 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,788 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:34,788 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:34,788 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:34,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b5730b[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:34,789 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:34,789 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,792 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:34,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:34,792 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,792 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:34,792 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:34,794 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:34,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:34,796 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:34,796 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:34,796 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:34,796 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,796 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:34,797 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,797 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:34,798 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:34,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:34,798 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,799 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:34,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,805 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:34,805 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:34,806 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:34,805 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:34,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:34,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:34,805 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:34,806 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,906 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:34,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:34,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:34,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:34,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,913 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:34,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:34,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:34,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:34,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,913 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,915 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,915 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:34,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:34,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:34,915 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:34,915 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:34,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:34,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:34,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:34,916 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:34,916 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:34,916 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:34,916 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:34,928 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014878e01f04f843cfb7a196a0718d6e03 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512014878e01f04f843cfb7a196a0718d6e03 2023-02-11 00:54:35,334 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/32c65b3b3fa742dbadfa5dc44f67c267 2023-02-11 00:54:35,339 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/32c65b3b3fa742dbadfa5dc44f67c267 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267 2023-02-11 00:54:35,343 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 00:54:35,343 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 427ms, sequenceid=13, compaction requested=true 2023-02-11 00:54:35,343 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:35,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:35,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:35,345 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,345 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:35,346 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,346 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:35,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:35,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ca4a25[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:35,347 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:35,347 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,348 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,349 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:35,349 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:35,349 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:35,349 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,349 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:35,351 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:35,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:35,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:35,352 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:35,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:35,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:35,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:35,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:35,354 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:35,354 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:35,354 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:35,354 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,354 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:35,355 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,355 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:35,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,355 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:35,356 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,357 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,359 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:35,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:35,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:35,359 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:35,360 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:35,360 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,360 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:35,360 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:35,460 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:35,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:35,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:35,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:35,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,466 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:35,466 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:35,466 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:35,467 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:35,467 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,467 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,468 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:35,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:35,468 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:35,468 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:35,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,469 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,470 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:35,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:35,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:35,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:35,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:35,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:35,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:35,470 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:35,470 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:35,470 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:35,884 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c709447602ec467da1734d317ddb17ed to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c709447602ec467da1734d317ddb17ed 2023-02-11 00:54:36,289 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/b484fd8ef15a41b48e5be6da19ca63e9 2023-02-11 00:54:36,294 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/b484fd8ef15a41b48e5be6da19ca63e9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9 2023-02-11 00:54:36,298 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 00:54:36,299 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 829ms, sequenceid=17, compaction requested=true 2023-02-11 00:54:36,299 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:36,299 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:36,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:36,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:36,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:36,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:36,300 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,300 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:36,301 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,301 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:36,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:36,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e4fbcd[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:36,302 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:36,302 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,303 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,303 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:36,303 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,303 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:36,303 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:36,303 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:36,305 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:36,305 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,305 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:36,305 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:36,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:36,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:36,307 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:36,307 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:36,307 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:36,307 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,307 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:36,310 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:36,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:36,310 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,311 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,313 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,313 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:36,313 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:36,313 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:36,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 00:54:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:36,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:36,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:36,313 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,313 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,314 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:36,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:36,414 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:36,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:36,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:36,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:36,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,420 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:36,420 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:36,420 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:36,421 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:36,421 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,421 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,422 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,422 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:36,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:36,422 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:36,422 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,423 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:36,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:36,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:36,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:36,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:36,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:36,424 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:36,424 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:36,424 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:36,424 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:36,837 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228caaeeb52a96b464bb59175928683f3db to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228caaeeb52a96b464bb59175928683f3db 2023-02-11 00:54:37,243 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/4b13b9abfd60491cbe767f5207323a06 2023-02-11 00:54:37,248 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/4b13b9abfd60491cbe767f5207323a06 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06 2023-02-11 00:54:37,253 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 00:54:37,254 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 830ms, sequenceid=21, compaction requested=true 2023-02-11 00:54:37,254 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:37,254 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:37,254 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:37,254 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:37,254 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,254 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:37,254 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,259 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:37,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:37,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72048419[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:37,261 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:37,261 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,262 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:37,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:37,262 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:37,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:37,264 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:37,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:37,266 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:37,266 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:37,266 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:37,266 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,266 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:37,268 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,268 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:37,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,268 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:37,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:37,268 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,270 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:37,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 00:54:37,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:37,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:37,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:37,274 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:37,274 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,274 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:37,274 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:37,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:37,374 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:37,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:37,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:37,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:37,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,380 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:37,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:37,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:37,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:37,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,382 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:37,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:37,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:37,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:37,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:37,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:37,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,383 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:37,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:37,383 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:37,384 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:37,384 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:37,384 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:37,384 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:37,542 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:54:37,588 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:37,588 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68bc3207 to 127.0.0.1:63942 2023-02-11 00:54:37,588 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:37,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:37,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56c675a8 to 127.0.0.1:63942 2023-02-11 00:54:37,590 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:37,594 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:54:37,594 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x769df65e to 127.0.0.1:63942 2023-02-11 00:54:37,594 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:54:37,796 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ae52d28a60624eba96b7ffa0b6706c80 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ae52d28a60624eba96b7ffa0b6706c80 2023-02-11 00:54:38,201 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/c6ef8dbf8fe04082bf9b4ebdec04338d 2023-02-11 00:54:38,205 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/c6ef8dbf8fe04082bf9b4ebdec04338d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d 2023-02-11 00:54:38,209 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 00:54:38,210 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 826ms, sequenceid=25, compaction requested=true 2023-02-11 00:54:38,210 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:38,210 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:38,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:38,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:38,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:38,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:38,212 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:38,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@613a8c79[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:38,213 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:38,213 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,215 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,215 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:38,215 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:38,215 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:38,215 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,215 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:38,216 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:38,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:38,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:38,219 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:38,219 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:38,219 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:38,219 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,219 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:38,221 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,221 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:38,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,221 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:38,222 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,223 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,225 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:38,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:38,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:38,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:38,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:38,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:38,225 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:38,226 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:38,326 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:38,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:38,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:38,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,332 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:38,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:38,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:38,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:38,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,333 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,333 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:38,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:38,334 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:38,334 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:38,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:38,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:38,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:38,335 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:38,335 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:38,335 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:38,335 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:38,335 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:38,335 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:38,335 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:38,335 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:38,749 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013a41ce9ce98e40c4bcbeec6a83a8174e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013a41ce9ce98e40c4bcbeec6a83a8174e 2023-02-11 00:54:39,154 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/de169afd246b473cbd4422b228793555 2023-02-11 00:54:39,159 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/de169afd246b473cbd4422b228793555 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555 2023-02-11 00:54:39,163 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 00:54:39,164 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 829ms, sequenceid=29, compaction requested=true 2023-02-11 00:54:39,164 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:39,164 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:39,164 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:39,164 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:39,164 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,164 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:39,164 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:39,166 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,166 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:39,166 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,166 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:39,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:39,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b9b7919[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:39,167 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:39,167 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,168 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,169 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:39,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:39,171 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:39,171 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:39,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:39,173 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:39,173 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:39,173 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:39,173 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,173 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:39,177 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:39,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:39,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:39,178 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,179 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:39,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:39,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:39,181 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:39,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,182 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,182 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:39,182 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:39,182 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,182 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,282 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:39,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:39,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,288 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:39,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:39,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:39,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:39,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,290 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,291 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:39,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:39,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:39,291 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:39,291 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:39,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:39,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:39,292 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:39,292 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:39,292 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:39,292 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:39,292 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:39,292 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:39,292 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:39,292 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:39,705 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f87e3c2e5dd64de7968cd0979f610bf8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f87e3c2e5dd64de7968cd0979f610bf8 2023-02-11 00:54:40,110 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/2de7cbd0faf647caa83a301717e60d04 2023-02-11 00:54:40,115 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/2de7cbd0faf647caa83a301717e60d04 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04 2023-02-11 00:54:40,119 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 00:54:40,120 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 828ms, sequenceid=33, compaction requested=true 2023-02-11 00:54:40,120 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:40,120 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:40,120 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:40,120 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:40,120 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,120 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:40,120 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:40,122 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,122 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:40,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:40,122 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,122 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:40,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:40,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:40,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:40,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:40,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f75db34[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:40,123 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:40,123 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,124 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:40,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:40,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:40,125 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,125 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:40,126 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,126 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:40,126 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:40,126 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:40,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:40,128 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:40,128 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:40,128 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:40,128 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,128 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:40,130 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:40,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:40,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:40,131 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:40,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,132 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:40,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,134 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:40,134 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:40,134 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:40,134 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:40,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:40,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:40,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:40,134 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:40,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:40,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,135 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:40,235 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:40,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:40,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:40,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:40,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,241 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:40,241 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:40,241 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:40,241 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:40,242 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,242 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,243 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,243 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:40,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:40,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:40,243 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:40,243 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:40,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,244 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:40,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:40,244 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:40,244 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:40,244 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:40,657 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090797aeb63456284f17bce60071ab05effe to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090797aeb63456284f17bce60071ab05effe 2023-02-11 00:54:41,063 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/3e7fa462b70d42bcb2736b3f67e505b1 2023-02-11 00:54:41,067 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/3e7fa462b70d42bcb2736b3f67e505b1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1 2023-02-11 00:54:41,071 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 00:54:41,072 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 828ms, sequenceid=37, compaction requested=true 2023-02-11 00:54:41,072 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:41,072 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:41,073 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,073 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:41,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:41,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5907a28f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:41,075 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:41,075 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,077 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:41,078 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,078 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:41,079 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,079 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:41,079 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:41,079 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:41,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:41,081 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:41,081 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:41,081 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:41,081 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,081 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:41,083 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,083 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:41,083 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:41,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:41,083 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,084 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:41,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:41,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:41,090 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:41,090 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:41,091 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,091 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:41,091 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,091 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:41,091 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,191 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:41,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:41,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:41,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:41,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,197 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:41,197 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:41,197 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 00:54:41,197 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 00:54:41,198 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,198 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,199 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:41,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:41,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:41,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 00:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 00:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 00:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:41,200 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:41,201 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:41,201 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. started... 2023-02-11 00:54:41,201 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4651ccd3f867fdf14b96e97db6fc4f5f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:41,613 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203ed561f2993447b081e0a4e0071ff8cf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203ed561f2993447b081e0a4e0071ff8cf 2023-02-11 00:54:42,018 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/2bdd3c974dbd4c76938ab92227380bc2 2023-02-11 00:54:42,023 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/2bdd3c974dbd4c76938ab92227380bc2 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2 2023-02-11 00:54:42,026 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 00:54:42,027 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4651ccd3f867fdf14b96e97db6fc4f5f in 826ms, sequenceid=41, compaction requested=true 2023-02-11 00:54:42,027 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:42,027 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 00:54:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 00:54:42,029 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:42,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:42,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 00:54:42,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ceba492[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:42,031 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 00:54:42,031 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,032 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,032 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 00:54:42,032 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 00:54:42,032 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:42,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:42,037 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 00:54:42,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:42,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 00:54:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:42,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 00:54:42,039 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 00:54:42,039 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:42,039 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:42,040 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,040 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:42,041 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,041 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,041 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:42,041 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,043 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,044 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,044 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:42,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 00:54:42,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:42,045 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:42,045 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:42,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:42,145 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:42,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:42,147 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:42,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:42,149 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:42,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:42,150 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077482150 2023-02-11 00:54:42,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:42,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 00:54:42,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:42,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x039704d9 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:42,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ecd238, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:42,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:42,994 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ff831371b98840b4a45426c5690c839d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ff831371b98840b4a45426c5690c839d 2023-02-11 00:54:42,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:43,007 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:43,008 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57486, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:43,014 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:43,015 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37020, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:43,027 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d7241887cdcd456b82c8816282abd6e9 first=Optional[r3] last=Optional[r6] 2023-02-11 00:54:43,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d7241887cdcd456b82c8816282abd6e9}] 2023-02-11 00:54:43,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d7241887cdcd456b82c8816282abd6e9 for inclusion in 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 00:54:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:43,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d7241887cdcd456b82c8816282abd6e9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__56hjfo7et8ci78sudutkq3f83jca640krenn22rtpfn3q7i269bcutl8s5ak29bv/family1/d7241887cdcd456b82c8816282abd6e9 2023-02-11 00:54:43,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__56hjfo7et8ci78sudutkq3f83jca640krenn22rtpfn3q7i269bcutl8s5ak29bv/family1/d7241887cdcd456b82c8816282abd6e9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_ 2023-02-11 00:54:43,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__56hjfo7et8ci78sudutkq3f83jca640krenn22rtpfn3q7i269bcutl8s5ak29bv/family1/d7241887cdcd456b82c8816282abd6e9 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_ - updating store file list. 2023-02-11 00:54:43,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_ into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:43,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__56hjfo7et8ci78sudutkq3f83jca640krenn22rtpfn3q7i269bcutl8s5ak29bv/family1/d7241887cdcd456b82c8816282abd6e9 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_) 2023-02-11 00:54:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__56hjfo7et8ci78sudutkq3f83jca640krenn22rtpfn3q7i269bcutl8s5ak29bv/family1/d7241887cdcd456b82c8816282abd6e9 2023-02-11 00:54:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:54:43,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:54:43,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 4651ccd3f867fdf14b96e97db6fc4f5f/family1 is initiating minor compaction 2023-02-11 00:54:43,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d9cb67c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:43,044 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4651ccd3f867fdf14b96e97db6fc4f5f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:43,044 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp, totalSize=50.4 K 2023-02-11 00:54:43,044 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting bb4337ce72ca451ca8559e917e575af7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:54:43,044 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 32c65b3b3fa742dbadfa5dc44f67c267, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b484fd8ef15a41b48e5be6da19ca63e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 4b13b9abfd60491cbe767f5207323a06, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c6ef8dbf8fe04082bf9b4ebdec04338d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting de169afd246b473cbd4422b228793555, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 2de7cbd0faf647caa83a301717e60d04, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 3e7fa462b70d42bcb2736b3f67e505b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 2bdd3c974dbd4c76938ab92227380bc2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:54:43,045 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 4003921e03c74422851722986b25e485_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:54:43,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:43,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:43,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228caaeeb52a96b464bb59175928683f3db to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228caaeeb52a96b464bb59175928683f3db 2023-02-11 00:54:43,049 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ae52d28a60624eba96b7ffa0b6706c80 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ae52d28a60624eba96b7ffa0b6706c80 2023-02-11 00:54:43,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013a41ce9ce98e40c4bcbeec6a83a8174e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601013a41ce9ce98e40c4bcbeec6a83a8174e 2023-02-11 00:54:43,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f87e3c2e5dd64de7968cd0979f610bf8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f87e3c2e5dd64de7968cd0979f610bf8 2023-02-11 00:54:43,051 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-11 00:54:43,051 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,065 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4651ccd3f867fdf14b96e97db6fc4f5f#family1#compaction#60 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:54:43,490 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/dc557b3528524a3d9cc08b712b21865c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/dc557b3528524a3d9cc08b712b21865c 2023-02-11 00:54:43,495 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4651ccd3f867fdf14b96e97db6fc4f5f/family1 of 4651ccd3f867fdf14b96e97db6fc4f5f into dc557b3528524a3d9cc08b712b21865c(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:54:43,495 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:43,495 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676076883044; duration=0sec 2023-02-11 00:54:43,495 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:43,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_] to archive 2023-02-11 00:54:43,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:43,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/bb4337ce72ca451ca8559e917e575af7 2023-02-11 00:54:43,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/32c65b3b3fa742dbadfa5dc44f67c267 2023-02-11 00:54:43,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/b484fd8ef15a41b48e5be6da19ca63e9 2023-02-11 00:54:43,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4b13b9abfd60491cbe767f5207323a06 2023-02-11 00:54:43,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/c6ef8dbf8fe04082bf9b4ebdec04338d 2023-02-11 00:54:43,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/de169afd246b473cbd4422b228793555 2023-02-11 00:54:43,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2de7cbd0faf647caa83a301717e60d04 2023-02-11 00:54:43,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3e7fa462b70d42bcb2736b3f67e505b1 2023-02-11 00:54:43,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/2bdd3c974dbd4c76938ab92227380bc2 2023-02-11 00:54:43,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/4003921e03c74422851722986b25e485_SeqId_44_ 2023-02-11 00:54:43,893 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055b4d974be5f94da6a3a550b99756e5ae to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055b4d974be5f94da6a3a550b99756e5ae 2023-02-11 00:54:43,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:43,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f1a71709caa42f587ba8cce999be3b9 first=Optional[r00] last=Optional[r2] 2023-02-11 00:54:43,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f1a71709caa42f587ba8cce999be3b9}] 2023-02-11 00:54:43,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f1a71709caa42f587ba8cce999be3b9 for inclusion in 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 00:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:43,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8f1a71709caa42f587ba8cce999be3b9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ooktnck1kt8iesvbu4ro07ptji0j3d8bc11n1k44cosni07n0au02qf7d3bv6qhk/family1/8f1a71709caa42f587ba8cce999be3b9 2023-02-11 00:54:43,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ooktnck1kt8iesvbu4ro07ptji0j3d8bc11n1k44cosni07n0au02qf7d3bv6qhk/family1/8f1a71709caa42f587ba8cce999be3b9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_ 2023-02-11 00:54:43,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ooktnck1kt8iesvbu4ro07ptji0j3d8bc11n1k44cosni07n0au02qf7d3bv6qhk/family1/8f1a71709caa42f587ba8cce999be3b9 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_ - updating store file list. 2023-02-11 00:54:43,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_ into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:43,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ooktnck1kt8iesvbu4ro07ptji0j3d8bc11n1k44cosni07n0au02qf7d3bv6qhk/family1/8f1a71709caa42f587ba8cce999be3b9 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_) 2023-02-11 00:54:43,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ooktnck1kt8iesvbu4ro07ptji0j3d8bc11n1k44cosni07n0au02qf7d3bv6qhk/family1/8f1a71709caa42f587ba8cce999be3b9 2023-02-11 00:54:43,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:54:43,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:54:43,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 4651ccd3f867fdf14b96e97db6fc4f5f/family1 is initiating minor compaction (all files) 2023-02-11 00:54:43,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1113ff9a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:43,930 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4651ccd3f867fdf14b96e97db6fc4f5f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:43,930 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/dc557b3528524a3d9cc08b712b21865c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp, totalSize=390.1 K 2023-02-11 00:54:43,931 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 587364346fb348d3be63590605e75662, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:54:43,931 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting dc557b3528524a3d9cc08b712b21865c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:54:43,932 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837900 2023-02-11 00:54:43,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:43,933 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:43,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004da4e293b724e7cb447f4c43f629c84 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113004da4e293b724e7cb447f4c43f629c84 2023-02-11 00:54:43,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512014878e01f04f843cfb7a196a0718d6e03 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512014878e01f04f843cfb7a196a0718d6e03 2023-02-11 00:54:43,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c709447602ec467da1734d317ddb17ed to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c709447602ec467da1734d317ddb17ed 2023-02-11 00:54:43,937 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-11 00:54:43,937 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 00:54:43,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:43,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:43,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:43,939 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:43,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.7910 sec 2023-02-11 00:54:43,949 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4651ccd3f867fdf14b96e97db6fc4f5f#family1#compaction#61 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:54:44,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 00:54:44,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:44,425 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 00:54:44,426 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:44,426 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 00:54:44,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 00:54:44,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE}] 2023-02-11 00:54:44,431 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE 2023-02-11 00:54:44,432 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:44,432 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076884432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076884432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076884432"}]},"ts":"1676076884432"} 2023-02-11 00:54:44,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:44,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:44,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4651ccd3f867fdf14b96e97db6fc4f5f, disabling compactions & flushes 2023-02-11 00:54:44,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,184 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/.tmp/family1/fe9f974d12c34550ba4454223d0b8ddb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/fe9f974d12c34550ba4454223d0b8ddb 2023-02-11 00:54:45,188 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4651ccd3f867fdf14b96e97db6fc4f5f/family1 of 4651ccd3f867fdf14b96e97db6fc4f5f into fe9f974d12c34550ba4454223d0b8ddb(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:54:45,188 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:45,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,188 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676076883930; duration=1sec 2023-02-11 00:54:45,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,188 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:54:45,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. after waiting 0 ms 2023-02-11 00:54:45,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,190 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/dc557b3528524a3d9cc08b712b21865c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_] to archive 2023-02-11 00:54:45,190 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:45,192 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/587364346fb348d3be63590605e75662 2023-02-11 00:54:45,193 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/dc557b3528524a3d9cc08b712b21865c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/dc557b3528524a3d9cc08b712b21865c 2023-02-11 00:54:45,194 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/33022c2a2020452c93e2cfda2d14bbd5_SeqId_47_ 2023-02-11 00:54:45,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 00:54:45,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Waiting for close lock at 1676076884585Running coprocessor pre-close hooks at 1676076884585Disabling compacts and flushes for region at 1676076884585Disabling writes for close at 1676076885188 (+603 ms)Writing region close event to WAL at 1676076885195 (+7 ms)Running coprocessor post-close hooks at 1676076885198 (+3 ms)Closed at 1676076885199 (+1 ms) 2023-02-11 00:54:45,199 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 4651ccd3f867fdf14b96e97db6fc4f5f to self. 2023-02-11 00:54:45,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,201 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=CLOSED 2023-02-11 00:54:45,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076885200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076885200"}]},"ts":"1676076885200"} 2023-02-11 00:54:45,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-11 00:54:45,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 769 msec 2023-02-11 00:54:45,203 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=true 2023-02-11 00:54:45,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:45,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076885354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076885354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076885354"}]},"ts":"1676076885354"} 2023-02-11 00:54:45,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:45,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4651ccd3f867fdf14b96e97db6fc4f5f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,510 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,511 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:45,511 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:45,511 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4651ccd3f867fdf14b96e97db6fc4f5f columnFamilyName family1 2023-02-11 00:54:45,515 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/fe9f974d12c34550ba4454223d0b8ddb 2023-02-11 00:54:45,515 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(310): Store=4651ccd3f867fdf14b96e97db6fc4f5f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:45,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:45,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4651ccd3f867fdf14b96e97db6fc4f5f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70890706, jitterRate=0.05635383725166321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:45,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Running coprocessor pre-open hook at 1676076885509Writing region info on filesystem at 1676076885509Initializing all the Stores at 1676076885509Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676076885510 (+1 ms)Cleaning up temporary data from old regions at 1676076885517 (+7 ms)Cleaning up detritus from prior splits at 1676076885518 (+1 ms)Running coprocessor post-open hooks at 1676076885520 (+2 ms)Region opened successfully at 1676076885520 2023-02-11 00:54:45,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., pid=47, masterSystemTime=1676076885506 2023-02-11 00:54:45,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:45,522 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:45,523 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076885522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076885522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076885522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076885522"}]},"ts":"1676076885522"} 2023-02-11 00:54:45,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-11 00:54:45,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 169 msec 2023-02-11 00:54:45,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-11 00:54:45,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE in 1.0940 sec 2023-02-11 00:54:45,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-11 00:54:45,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1000 sec 2023-02-11 00:54:45,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5150 sec 2023-02-11 00:54:45,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-11 00:54:45,533 INFO [Listener at localhost/36341] compactions.TestMobCompactor(278): alter status finished 2023-02-11 00:54:45,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:45,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:45,535 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:45,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:45,536 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077485536 2023-02-11 00:54:45,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:45,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 00:54:45,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:45,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x33742772 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:45,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d475e36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:45,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:45,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:45,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:45,542 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:45,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:46,367 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281a017a229b9f45978dadc22063ab02c9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511281a017a229b9f45978dadc22063ab02c9 2023-02-11 00:54:46,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:46,381 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:54:46,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:54:46,388 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:54:46,389 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:54:46,397 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/699fece3cc924a79a036893baf1550c0 first=Optional[r05] last=Optional[r8] 2023-02-11 00:54:46,397 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/699fece3cc924a79a036893baf1550c0}] 2023-02-11 00:54:46,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/699fece3cc924a79a036893baf1550c0 for inclusion in 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:46,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 00:54:46,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:54:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 4651ccd3f867fdf14b96e97db6fc4f5f: 2023-02-11 00:54:46,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/699fece3cc924a79a036893baf1550c0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pv47ihicnfqfkarh5dftaje42g1gajp5bhnth93331mrubrbu5adiv2lcvv1gk5h/family1/699fece3cc924a79a036893baf1550c0 2023-02-11 00:54:46,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pv47ihicnfqfkarh5dftaje42g1gajp5bhnth93331mrubrbu5adiv2lcvv1gk5h/family1/699fece3cc924a79a036893baf1550c0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3d6ccd20065f4b9eb095b4fb01f98407_SeqId_53_ 2023-02-11 00:54:46,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pv47ihicnfqfkarh5dftaje42g1gajp5bhnth93331mrubrbu5adiv2lcvv1gk5h/family1/699fece3cc924a79a036893baf1550c0 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3d6ccd20065f4b9eb095b4fb01f98407_SeqId_53_ - updating store file list. 2023-02-11 00:54:46,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3d6ccd20065f4b9eb095b4fb01f98407_SeqId_53_ into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:46,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pv47ihicnfqfkarh5dftaje42g1gajp5bhnth93331mrubrbu5adiv2lcvv1gk5h/family1/699fece3cc924a79a036893baf1550c0 into 4651ccd3f867fdf14b96e97db6fc4f5f/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3d6ccd20065f4b9eb095b4fb01f98407_SeqId_53_) 2023-02-11 00:54:46,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pv47ihicnfqfkarh5dftaje42g1gajp5bhnth93331mrubrbu5adiv2lcvv1gk5h/family1/699fece3cc924a79a036893baf1550c0 2023-02-11 00:54:46,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:46,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:54:46,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203ed561f2993447b081e0a4e0071ff8cf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511203ed561f2993447b081e0a4e0071ff8cf 2023-02-11 00:54:46,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128766c0f9dc1a048fcb8894a569be3c863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128766c0f9dc1a048fcb8894a569be3c863 2023-02-11 00:54:46,417 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-11 00:54:46,417 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 00:54:46,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:46,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:46,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:46,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:46,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:46,418 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:46,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 884 msec 2023-02-11 00:54:46,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:54:46,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:46,881 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 00:54:46,882 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 00:54:46,882 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 00:54:46,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 00:54:46,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE}] 2023-02-11 00:54:46,887 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE 2023-02-11 00:54:46,888 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:46,888 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076886888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076886888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076886888"}]},"ts":"1676076886888"} 2023-02-11 00:54:46,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:47,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4651ccd3f867fdf14b96e97db6fc4f5f, disabling compactions & flushes 2023-02-11 00:54:47,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. after waiting 0 ms 2023-02-11 00:54:47,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 00:54:47,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Waiting for close lock at 1676076887041Running coprocessor pre-close hooks at 1676076887041Disabling compacts and flushes for region at 1676076887041Disabling writes for close at 1676076887041Writing region close event to WAL at 1676076887043 (+2 ms)Running coprocessor post-close hooks at 1676076887047 (+4 ms)Closed at 1676076887047 2023-02-11 00:54:47,047 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 4651ccd3f867fdf14b96e97db6fc4f5f to self. 2023-02-11 00:54:47,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,049 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=CLOSED 2023-02-11 00:54:47,049 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076887049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076887049"}]},"ts":"1676076887049"} 2023-02-11 00:54:47,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-11 00:54:47,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 161 msec 2023-02-11 00:54:47,052 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=true 2023-02-11 00:54:47,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:47,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076887202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076887202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076887202"}]},"ts":"1676076887202"} 2023-02-11 00:54:47,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:47,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4651ccd3f867fdf14b96e97db6fc4f5f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:47,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:47,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,360 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,361 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:47,361 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1 2023-02-11 00:54:47,361 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4651ccd3f867fdf14b96e97db6fc4f5f columnFamilyName family1 2023-02-11 00:54:47,366 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/3d6ccd20065f4b9eb095b4fb01f98407_SeqId_53_ 2023-02-11 00:54:47,368 DEBUG [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/family1/fe9f974d12c34550ba4454223d0b8ddb 2023-02-11 00:54:47,369 INFO [StoreOpener-4651ccd3f867fdf14b96e97db6fc4f5f-1] regionserver.HStore(310): Store=4651ccd3f867fdf14b96e97db6fc4f5f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:47,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:54:47,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4651ccd3f867fdf14b96e97db6fc4f5f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74891494, jitterRate=0.11597022414207458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:47,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Running coprocessor pre-open hook at 1676076887359Writing region info on filesystem at 1676076887359Initializing all the Stores at 1676076887359Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076887359Cleaning up temporary data from old regions at 1676076887371 (+12 ms)Cleaning up detritus from prior splits at 1676076887371Running coprocessor post-open hooks at 1676076887374 (+3 ms)Region opened successfully at 1676076887374 2023-02-11 00:54:47,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f., pid=53, masterSystemTime=1676076887355 2023-02-11 00:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:54:47,376 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4651ccd3f867fdf14b96e97db6fc4f5f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:47,377 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676076887376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076887376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076887376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076887376"}]},"ts":"1676076887376"} 2023-02-11 00:54:47,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-11 00:54:47,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 4651ccd3f867fdf14b96e97db6fc4f5f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 174 msec 2023-02-11 00:54:47,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-11 00:54:47,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4651ccd3f867fdf14b96e97db6fc4f5f, REOPEN/MOVE in 493 msec 2023-02-11 00:54:47,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-11 00:54:47,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-02-11 00:54:47,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 912 msec 2023-02-11 00:54:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-11 00:54:47,386 INFO [Listener at localhost/36341] compactions.TestMobCompactor(278): alter status finished 2023-02-11 00:54:47,387 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 00:54:47,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:47,389 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:47,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:47,389 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077487389 2023-02-11 00:54:47,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:47,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 00:54:47,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:47,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x25c9cfd7 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:47,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62b893b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,396 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 00:54:47,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 00:54:47,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:47,397 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 00:54:47,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-02-11 00:54:47,457 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=242 (was 264), OpenFileDescriptor=613 (was 629), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 241), ProcessCount=168 (was 168), AvailableMemoryMB=3121 (was 3178) 2023-02-11 00:54:47,467 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=3120 2023-02-11 00:54:47,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 00:54:47,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:47,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:54:47,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-11 00:54:47,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:54:47,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:47,472 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:47,472 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d empty. 2023-02-11 00:54:47,473 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:47,473 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-11 00:54:47,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:47,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:47,880 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 00:54:47,881 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8e4998376fc5760496e5e507b5b5e79d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:54:48,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 8e4998376fc5760496e5e507b5b5e79d, disabling compactions & flushes 2023-02-11 00:54:48,288 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. after waiting 0 ms 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,288 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,288 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 8e4998376fc5760496e5e507b5b5e79d: Waiting for close lock at 1676076888288Disabling compacts and flushes for region at 1676076888288Disabling writes for close at 1676076888288Writing region close event to WAL at 1676076888288Closed at 1676076888288 2023-02-11 00:54:48,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:54:48,292 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076888292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076888292"}]},"ts":"1676076888292"} 2023-02-11 00:54:48,293 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:54:48,294 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:54:48,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076888294"}]},"ts":"1676076888294"} 2023-02-11 00:54:48,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-11 00:54:48,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, ASSIGN}] 2023-02-11 00:54:48,299 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, ASSIGN 2023-02-11 00:54:48,300 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:54:48,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:48,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076888451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076888451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076888451"}]},"ts":"1676076888451"} 2023-02-11 00:54:48,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:54:48,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:48,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e4998376fc5760496e5e507b5b5e79d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,608 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,610 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:54:48,610 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:54:48,610 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e4998376fc5760496e5e507b5b5e79d columnFamilyName family1 2023-02-11 00:54:48,611 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(310): Store=8e4998376fc5760496e5e507b5b5e79d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:54:48,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:54:48,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:54:48,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e4998376fc5760496e5e507b5b5e79d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61293536, jitterRate=-0.0866551399230957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:54:48,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e4998376fc5760496e5e507b5b5e79d: Running coprocessor pre-open hook at 1676076888607Writing region info on filesystem at 1676076888607Initializing all the Stores at 1676076888608 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676076888608Cleaning up temporary data from old regions at 1676076888613 (+5 ms)Cleaning up detritus from prior splits at 1676076888613Running coprocessor post-open hooks at 1676076888617 (+4 ms)Region opened successfully at 1676076888617 2023-02-11 00:54:48,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., pid=57, masterSystemTime=1676076888604 2023-02-11 00:54:48,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:48,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:48,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076888620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076888620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076888620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076888620"}]},"ts":"1676076888620"} 2023-02-11 00:54:48,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-11 00:54:48,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915 in 168 msec 2023-02-11 00:54:48,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-11 00:54:48,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, ASSIGN in 324 msec 2023-02-11 00:54:48,624 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:54:48,624 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076888624"}]},"ts":"1676076888624"} 2023-02-11 00:54:48,625 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-11 00:54:48,627 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:54:48,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-02-11 00:54:49,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 00:54:49,576 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-11 00:54:49,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:49,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,593 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:49,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:49,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:49,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:49,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,595 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:49,595 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:49,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:49,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:49,595 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,596 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:49,596 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:49,596 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:49,597 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:49,600 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:49,600 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:49,600 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:49,600 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:49,600 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:54:50,022 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130362e41ba74d040b0bc0c2b786e7f6e72 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130362e41ba74d040b0bc0c2b786e7f6e72 2023-02-11 00:54:50,425 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/bafc1863d8e0443ab42c70f56661274e 2023-02-11 00:54:50,430 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/bafc1863d8e0443ab42c70f56661274e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e 2023-02-11 00:54:50,434 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-11 00:54:50,435 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 835ms, sequenceid=5, compaction requested=false 2023-02-11 00:54:50,435 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:50,435 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:50,435 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:50,435 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:50,435 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:50,437 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,437 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:50,437 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:50,438 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:50,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:50,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c384ba7[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:50,439 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:50,439 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,440 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:50,440 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,440 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:50,442 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:50,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:50,445 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:50,445 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:50,445 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:50,445 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,445 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:50,446 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,446 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,447 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:50,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:50,447 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:50,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,448 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:50,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:50,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:50,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:50,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:50,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,458 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:50,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:50,459 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:50,559 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:50,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:50,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:50,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:50,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,565 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:50,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:50,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:50,565 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:50,566 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,566 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,567 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,567 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:50,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:50,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:50,567 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:50,567 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:50,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:50,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,568 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,568 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:50,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:50,568 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:50,568 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:50,568 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:54:50,727 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:54:50,980 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128865397cc01cf456db6116a247758c19c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128865397cc01cf456db6116a247758c19c 2023-02-11 00:54:51,385 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/2dd6b1d80e2b488887479ac3bc02ce3b 2023-02-11 00:54:51,390 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/2dd6b1d80e2b488887479ac3bc02ce3b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b 2023-02-11 00:54:51,394 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:54:51,395 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 827ms, sequenceid=9, compaction requested=false 2023-02-11 00:54:51,395 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:51,395 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:51,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:51,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:51,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:51,395 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:51,396 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,396 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:51,397 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,397 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:51,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:51,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4db5816f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:51,398 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:51,398 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,400 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,400 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:51,400 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:51,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,400 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:51,400 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:51,401 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,401 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:51,401 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:51,401 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:51,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:51,403 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:51,404 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:51,404 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:51,404 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,404 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:51,405 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,405 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:51,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,405 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:51,405 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,406 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,408 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,408 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:51,408 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,408 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:51,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:51,409 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:51,408 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:51,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:51,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,409 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,509 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:51,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:51,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,515 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:51,515 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:51,515 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:51,515 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:51,516 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,516 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,518 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,518 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:51,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:51,518 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:51,518 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:51,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:51,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:51,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:51,519 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:51,519 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:51,519 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:51,932 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017a60641de73b447abc57f0fbbac06036 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017a60641de73b447abc57f0fbbac06036 2023-02-11 00:54:52,337 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/33691905f8dd4ba88eb05fc9c4aa67cb 2023-02-11 00:54:52,341 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/33691905f8dd4ba88eb05fc9c4aa67cb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb 2023-02-11 00:54:52,345 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 00:54:52,346 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 827ms, sequenceid=13, compaction requested=true 2023-02-11 00:54:52,346 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:52,346 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:52,347 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:52,347 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:52,347 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,347 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:52,347 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:52,348 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:52,348 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,349 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,349 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:52,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:52,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2942518c[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:52,351 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:52,351 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,352 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,352 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:52,352 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:52,352 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,352 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:52,352 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:52,354 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,354 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:52,354 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:52,354 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:52,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:52,357 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:52,357 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:52,357 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:52,357 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,357 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:52,360 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,360 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:52,360 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:52,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:52,361 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,362 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,364 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,364 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,364 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:52,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:52,365 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:52,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:52,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:52,365 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:52,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:52,465 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:52,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:52,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,471 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:52,471 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:52,471 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:52,471 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:52,472 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,472 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,473 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,473 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:52,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:52,473 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:52,473 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,474 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:52,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:52,474 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:52,474 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:52,474 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:52,474 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:52,474 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:52,475 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:52,475 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:52,475 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:52,891 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ba82df30d4324139bf9e2fc35fc9922a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba82df30d4324139bf9e2fc35fc9922a 2023-02-11 00:54:53,297 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/46ead9eaaf414eedafc123108afb51ed 2023-02-11 00:54:53,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/46ead9eaaf414eedafc123108afb51ed as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed 2023-02-11 00:54:53,305 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 00:54:53,306 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 831ms, sequenceid=17, compaction requested=true 2023-02-11 00:54:53,306 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:53,306 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:53,306 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,308 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:53,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:53,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18bcaf02[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:53,309 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:53,309 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,314 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:53,314 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:53,314 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,314 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:53,315 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,315 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:53,315 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:53,315 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:53,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:53,317 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:53,317 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:53,317 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:53,317 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,317 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:53,319 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,319 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:53,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,319 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:53,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:53,319 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:53,320 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:53,324 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:53,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:53,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:53,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:53,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:53,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:53,324 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:53,425 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:53,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:53,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:53,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:53,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,430 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:53,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:53,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:53,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:53,431 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,431 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,432 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,432 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:53,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:53,433 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:53,433 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:53,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,434 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:53,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:53,434 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:53,434 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:53,434 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:53,434 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:53,845 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288bb6cb213e4543ed954c102fefb3f7bf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512288bb6cb213e4543ed954c102fefb3f7bf 2023-02-11 00:54:54,250 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/94f80ab913d84b30bcb7b49df56f4a3c 2023-02-11 00:54:54,255 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/94f80ab913d84b30bcb7b49df56f4a3c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c 2023-02-11 00:54:54,258 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 00:54:54,259 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 825ms, sequenceid=21, compaction requested=true 2023-02-11 00:54:54,259 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:54,259 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:54,261 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,261 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:54,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:54,261 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,261 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:54,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:54,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:54,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:54,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36f7bac1[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:54,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:54,262 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,263 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,263 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:54,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:54,264 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:54,264 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,264 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:54,266 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:54,267 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:54,268 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:54,268 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:54,268 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,268 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:54,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:54,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,269 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:54,270 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,271 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:54,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:54,373 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:54,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:54,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:54,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,379 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:54,379 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:54,379 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:54,379 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:54,379 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,379 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,381 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:54,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:54,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:54,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:54,382 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:54,382 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:54,382 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:54,793 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a958e4e0762e4c7a81dc183351bf71d9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a958e4e0762e4c7a81dc183351bf71d9 2023-02-11 00:54:55,198 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/b359349e46904c45ba6fb9ba8ac64593 2023-02-11 00:54:55,203 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/b359349e46904c45ba6fb9ba8ac64593 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593 2023-02-11 00:54:55,206 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 00:54:55,207 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 825ms, sequenceid=25, compaction requested=true 2023-02-11 00:54:55,207 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:55,207 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:55,207 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:55,207 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:55,208 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,208 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:55,208 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:55,210 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,210 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:55,211 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,211 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:55,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:55,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5728fb89[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:55,212 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:55,212 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,213 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:55,213 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,213 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:55,214 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:55,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:55,216 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:55,217 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:55,217 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:55,217 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,217 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:55,218 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,218 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,218 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:55,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:55,219 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,220 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,225 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:55,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:55,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:55,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,226 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,226 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:55,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:55,326 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:55,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:55,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:55,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:55,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,332 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,336 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,336 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:55,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:55,336 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:55,336 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,337 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:55,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:55,338 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:55,338 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:55,338 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:55,338 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:55,338 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:55,750 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017d484a37b2b249d3a3591a68ee13511e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017d484a37b2b249d3a3591a68ee13511e 2023-02-11 00:54:56,155 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/8491a3a5f5254d17a58c039da95e6097 2023-02-11 00:54:56,160 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/8491a3a5f5254d17a58c039da95e6097 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097 2023-02-11 00:54:56,164 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 00:54:56,164 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 826ms, sequenceid=29, compaction requested=true 2023-02-11 00:54:56,164 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:56,164 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:56,166 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:56,167 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,167 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:56,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:56,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cdd0ed1[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:56,168 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:56,168 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,169 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,169 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:56,170 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,170 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:56,172 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:56,172 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:56,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:56,174 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:56,174 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:56,174 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:56,174 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,174 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:56,175 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,175 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:56,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,175 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:56,176 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,177 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:56,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:56,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:56,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,179 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:56,178 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:56,179 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:56,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:56,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:56,279 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:56,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:56,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:56,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,286 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:56,286 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:56,286 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:56,286 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:56,287 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,287 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,288 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:56,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:56,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:56,288 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:56,289 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:56,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:56,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:56,290 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:56,290 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:56,290 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:56,296 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:56,296 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:56,296 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:56,296 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:56,296 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:56,710 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039cd688b1ee414e6a8bc3bfa6cdc1b1f1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd688b1ee414e6a8bc3bfa6cdc1b1f1 2023-02-11 00:54:57,115 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/9e121077ba0a4fbbaac1fd7d26efe6b8 2023-02-11 00:54:57,120 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/9e121077ba0a4fbbaac1fd7d26efe6b8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8 2023-02-11 00:54:57,124 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 00:54:57,125 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 829ms, sequenceid=33, compaction requested=true 2023-02-11 00:54:57,125 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:57,125 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:57,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:57,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:57,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:57,125 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:57,128 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:57,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:57,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11e478f7[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:57,130 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:57,130 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,131 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:57,131 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,131 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:57,132 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,132 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:57,132 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:57,132 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:57,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:57,135 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:57,135 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:57,135 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:57,135 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,135 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:57,136 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,136 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:57,136 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:57,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:57,137 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,138 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,141 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:57,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:57,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:57,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:57,142 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:57,141 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:57,242 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:57,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:57,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:57,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:57,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,248 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:57,248 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:57,248 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:57,248 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:57,248 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,248 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,250 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,250 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:57,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:57,250 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:57,250 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:57,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:57,251 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:57,251 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:57,251 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:57,251 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:57,251 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:57,251 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:57,251 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:57,252 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:57,664 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ed348a3cb2d247aeb0c49a71748191e3 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ed348a3cb2d247aeb0c49a71748191e3 2023-02-11 00:54:58,069 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/af3b6ff1711045aea794667329706186 2023-02-11 00:54:58,073 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/af3b6ff1711045aea794667329706186 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186 2023-02-11 00:54:58,077 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 00:54:58,078 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 826ms, sequenceid=37, compaction requested=true 2023-02-11 00:54:58,078 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:58,078 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:58,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:58,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:58,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:58,078 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:58,079 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,079 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:58,080 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,080 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:58,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:58,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a4ef9b8[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:58,081 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:58,081 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,083 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,083 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:58,083 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:58,083 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:58,083 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,083 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:58,085 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:58,085 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,085 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:58,085 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:58,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:58,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:58,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:58,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:58,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:58,087 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:58,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:58,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:58,087 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,087 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:58,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:58,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,090 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:58,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:58,092 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:58,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:58,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:58,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:58,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:58,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:58,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,093 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:58,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,193 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:58,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:58,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:54:58,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 00:54:58,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,199 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:58,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:58,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 00:54:58,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 00:54:58,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,201 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,201 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:58,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:58,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:58,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:54:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:54:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,203 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 00:54:58,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 00:54:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:54:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 00:54:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:54:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:54:58,203 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:58,203 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. started... 2023-02-11 00:54:58,203 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e4998376fc5760496e5e507b5b5e79d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:54:58,615 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f1db1dc19702449eb51bbf9d543bb53c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f1db1dc19702449eb51bbf9d543bb53c 2023-02-11 00:54:59,020 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/b9b8971ebe59400892bbeb685bcb135c 2023-02-11 00:54:59,025 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/b9b8971ebe59400892bbeb685bcb135c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c 2023-02-11 00:54:59,028 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 00:54:59,029 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e4998376fc5760496e5e507b5b5e79d in 826ms, sequenceid=41, compaction requested=true 2023-02-11 00:54:59,029 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:54:59,029 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:54:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:54:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:54:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 00:54:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 00:54:59,030 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,030 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:59,031 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,031 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:59,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 00:54:59,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aaabdcb[Count = 0] remaining members to acquire global barrier 2023-02-11 00:54:59,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 00:54:59,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,033 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,033 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 00:54:59,033 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 00:54:59,033 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,033 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:54:59,033 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 00:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:59,034 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 00:54:59,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:59,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:54:59,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 00:54:59,036 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 00:54:59,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:54:59,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:54:59,037 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,037 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:54:59,039 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,039 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,039 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:54:59,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:59,040 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:54:59,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,041 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:54:59,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:54:59,043 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 00:54:59,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:54:59,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 00:54:59,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:54:59,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,043 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 00:54:59,044 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,044 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:54:59,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:54:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:54:59,044 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,144 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:54:59,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:54:59,146 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:54:59,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:54:59,148 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:54:59,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:54:59,148 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077499148 2023-02-11 00:54:59,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:54:59,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 00:54:59,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:54:59,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x4684fdaa to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:54:59,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53d2856f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:54:59,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:54:59,991 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034bfb4118d63c49ccacb3d1843303a070 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034bfb4118d63c49ccacb3d1843303a070 2023-02-11 00:54:59,992 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:00,004 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:00,006 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:00,011 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:00,012 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40764, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:00,020 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c5a3f02aea240d196c8a96f3b8852a8 first=Optional[r3] last=Optional[r6] 2023-02-11 00:55:00,021 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c5a3f02aea240d196c8a96f3b8852a8}] 2023-02-11 00:55:00,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c5a3f02aea240d196c8a96f3b8852a8 for inclusion in 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:00,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 00:55:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:55:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:55:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c5a3f02aea240d196c8a96f3b8852a8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__krvuhm0n4m3ap90a4u3gqqnt3va7jehq6fgi3to91boc3u1j9rhb2r13mjbqc1i0/family1/6c5a3f02aea240d196c8a96f3b8852a8 2023-02-11 00:55:00,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__krvuhm0n4m3ap90a4u3gqqnt3va7jehq6fgi3to91boc3u1j9rhb2r13mjbqc1i0/family1/6c5a3f02aea240d196c8a96f3b8852a8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_ 2023-02-11 00:55:00,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__krvuhm0n4m3ap90a4u3gqqnt3va7jehq6fgi3to91boc3u1j9rhb2r13mjbqc1i0/family1/6c5a3f02aea240d196c8a96f3b8852a8 into 8e4998376fc5760496e5e507b5b5e79d/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_ - updating store file list. 2023-02-11 00:55:00,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_ into 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:00,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__krvuhm0n4m3ap90a4u3gqqnt3va7jehq6fgi3to91boc3u1j9rhb2r13mjbqc1i0/family1/6c5a3f02aea240d196c8a96f3b8852a8 into 8e4998376fc5760496e5e507b5b5e79d/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_) 2023-02-11 00:55:00,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__krvuhm0n4m3ap90a4u3gqqnt3va7jehq6fgi3to91boc3u1j9rhb2r13mjbqc1i0/family1/6c5a3f02aea240d196c8a96f3b8852a8 2023-02-11 00:55:00,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:55:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:55:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 8e4998376fc5760496e5e507b5b5e79d/family1 is initiating minor compaction 2023-02-11 00:55:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6210ebfa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:00,036 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8e4998376fc5760496e5e507b5b5e79d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:00,037 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp, totalSize=50.3 K 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 2dd6b1d80e2b488887479ac3bc02ce3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 33691905f8dd4ba88eb05fc9c4aa67cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 46ead9eaaf414eedafc123108afb51ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 94f80ab913d84b30bcb7b49df56f4a3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b359349e46904c45ba6fb9ba8ac64593, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 8491a3a5f5254d17a58c039da95e6097, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 9e121077ba0a4fbbaac1fd7d26efe6b8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting af3b6ff1711045aea794667329706186, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b9b8971ebe59400892bbeb685bcb135c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:55:00,037 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 958c655886334d93acbcbf9758998538_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:55:00,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:00,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:00,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512288bb6cb213e4543ed954c102fefb3f7bf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512288bb6cb213e4543ed954c102fefb3f7bf 2023-02-11 00:55:00,041 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a958e4e0762e4c7a81dc183351bf71d9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a958e4e0762e4c7a81dc183351bf71d9 2023-02-11 00:55:00,043 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017d484a37b2b249d3a3591a68ee13511e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017d484a37b2b249d3a3591a68ee13511e 2023-02-11 00:55:00,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd688b1ee414e6a8bc3bfa6cdc1b1f1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd688b1ee414e6a8bc3bfa6cdc1b1f1 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-11 00:55:00,044 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,076 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e4998376fc5760496e5e507b5b5e79d#family1#compaction#72 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:00,889 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/e93093db7c0745399e3c5230dcec5b6c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/e93093db7c0745399e3c5230dcec5b6c 2023-02-11 00:55:00,893 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8e4998376fc5760496e5e507b5b5e79d/family1 of 8e4998376fc5760496e5e507b5b5e79d into e93093db7c0745399e3c5230dcec5b6c(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:55:00,893 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:55:00,894 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676076900036; duration=0sec 2023-02-11 00:55:00,894 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:00,898 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051af7147182754484b4c558e9d3f8576a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051af7147182754484b4c558e9d3f8576a 2023-02-11 00:55:00,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:00,921 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d7b74a9dc2649b8bfa2d209d670525a first=Optional[r00] last=Optional[r2] 2023-02-11 00:55:00,922 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d7b74a9dc2649b8bfa2d209d670525a}] 2023-02-11 00:55:00,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d7b74a9dc2649b8bfa2d209d670525a for inclusion in 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:00,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 00:55:00,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:55:00,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:55:00,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d7b74a9dc2649b8bfa2d209d670525a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__goc9lq4tvm0o14gd480m5rvp47n4baok06ckqjhr6pm197qlj78rn48nrcbpth0f/family1/6d7b74a9dc2649b8bfa2d209d670525a 2023-02-11 00:55:00,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__goc9lq4tvm0o14gd480m5rvp47n4baok06ckqjhr6pm197qlj78rn48nrcbpth0f/family1/6d7b74a9dc2649b8bfa2d209d670525a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_ 2023-02-11 00:55:00,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__goc9lq4tvm0o14gd480m5rvp47n4baok06ckqjhr6pm197qlj78rn48nrcbpth0f/family1/6d7b74a9dc2649b8bfa2d209d670525a into 8e4998376fc5760496e5e507b5b5e79d/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_ - updating store file list. 2023-02-11 00:55:00,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_ into 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:00,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__goc9lq4tvm0o14gd480m5rvp47n4baok06ckqjhr6pm197qlj78rn48nrcbpth0f/family1/6d7b74a9dc2649b8bfa2d209d670525a into 8e4998376fc5760496e5e507b5b5e79d/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_) 2023-02-11 00:55:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__goc9lq4tvm0o14gd480m5rvp47n4baok06ckqjhr6pm197qlj78rn48nrcbpth0f/family1/6d7b74a9dc2649b8bfa2d209d670525a 2023-02-11 00:55:00,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:55:00,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:55:00,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 8e4998376fc5760496e5e507b5b5e79d/family1 is initiating minor compaction (all files) 2023-02-11 00:55:00,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@67c3e5e2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:00,935 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8e4998376fc5760496e5e507b5b5e79d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:00,935 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/e93093db7c0745399e3c5230dcec5b6c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp, totalSize=388.1 K 2023-02-11 00:55:00,935 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting bafc1863d8e0443ab42c70f56661274e, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:55:00,936 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting e93093db7c0745399e3c5230dcec5b6c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:55:00,936 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 93011f8f101547d29c50fb6c8637fd3b_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837900 2023-02-11 00:55:00,936 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:00,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:00,938 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130362e41ba74d040b0bc0c2b786e7f6e72 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130362e41ba74d040b0bc0c2b786e7f6e72 2023-02-11 00:55:00,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017a60641de73b447abc57f0fbbac06036 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017a60641de73b447abc57f0fbbac06036 2023-02-11 00:55:00,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba82df30d4324139bf9e2fc35fc9922a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba82df30d4324139bf9e2fc35fc9922a 2023-02-11 00:55:00,940 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-11 00:55:00,940 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 00:55:00,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:00,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:00,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:00,942 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:00,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7960 sec 2023-02-11 00:55:00,952 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e4998376fc5760496e5e507b5b5e79d#family1#compaction#73 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:00,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_] to archive 2023-02-11 00:55:00,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:00,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/2dd6b1d80e2b488887479ac3bc02ce3b 2023-02-11 00:55:00,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/33691905f8dd4ba88eb05fc9c4aa67cb 2023-02-11 00:55:00,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/46ead9eaaf414eedafc123108afb51ed 2023-02-11 00:55:00,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/94f80ab913d84b30bcb7b49df56f4a3c 2023-02-11 00:55:00,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b359349e46904c45ba6fb9ba8ac64593 2023-02-11 00:55:00,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/8491a3a5f5254d17a58c039da95e6097 2023-02-11 00:55:00,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/9e121077ba0a4fbbaac1fd7d26efe6b8 2023-02-11 00:55:00,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/af3b6ff1711045aea794667329706186 2023-02-11 00:55:00,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b9b8971ebe59400892bbeb685bcb135c 2023-02-11 00:55:00,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/958c655886334d93acbcbf9758998538_SeqId_44_ 2023-02-11 00:55:01,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 00:55:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:55:01,434 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 00:55:01,435 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:01,435 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 00:55:01,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 00:55:01,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE}] 2023-02-11 00:55:01,439 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE 2023-02-11 00:55:01,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:01,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076901440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076901440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076901440"}]},"ts":"1676076901440"} 2023-02-11 00:55:01,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:01,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:01,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e4998376fc5760496e5e507b5b5e79d, disabling compactions & flushes 2023-02-11 00:55:01,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,168 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/.tmp/family1/b3f94a5b627e4a4697c680c8af80b1b7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b3f94a5b627e4a4697c680c8af80b1b7 2023-02-11 00:55:02,173 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8e4998376fc5760496e5e507b5b5e79d/family1 of 8e4998376fc5760496e5e507b5b5e79d into b3f94a5b627e4a4697c680c8af80b1b7(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:02,173 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:55:02,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,173 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676076900935; duration=1sec 2023-02-11 00:55:02,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. after waiting 0 ms 2023-02-11 00:55:02,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,173 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:02,176 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/e93093db7c0745399e3c5230dcec5b6c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_] to archive 2023-02-11 00:55:02,176 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:02,178 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/bafc1863d8e0443ab42c70f56661274e 2023-02-11 00:55:02,179 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/e93093db7c0745399e3c5230dcec5b6c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/e93093db7c0745399e3c5230dcec5b6c 2023-02-11 00:55:02,180 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/93011f8f101547d29c50fb6c8637fd3b_SeqId_47_ 2023-02-11 00:55:02,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 00:55:02,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e4998376fc5760496e5e507b5b5e79d: Waiting for close lock at 1676076901593Running coprocessor pre-close hooks at 1676076901593Disabling compacts and flushes for region at 1676076901593Disabling writes for close at 1676076902173 (+580 ms)Writing region close event to WAL at 1676076902181 (+8 ms)Running coprocessor post-close hooks at 1676076902185 (+4 ms)Closed at 1676076902185 2023-02-11 00:55:02,185 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8e4998376fc5760496e5e507b5b5e79d to self. 2023-02-11 00:55:02,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,187 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=CLOSED 2023-02-11 00:55:02,187 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076902187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076902187"}]},"ts":"1676076902187"} 2023-02-11 00:55:02,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-11 00:55:02,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915 in 747 msec 2023-02-11 00:55:02,189 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=true 2023-02-11 00:55:02,339 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:02,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076902339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076902339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076902339"}]},"ts":"1676076902339"} 2023-02-11 00:55:02,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:02,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e4998376fc5760496e5e507b5b5e79d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:55:02,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:02,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,497 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,498 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:02,498 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:02,498 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e4998376fc5760496e5e507b5b5e79d columnFamilyName family1 2023-02-11 00:55:02,502 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b3f94a5b627e4a4697c680c8af80b1b7 2023-02-11 00:55:02,503 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(310): Store=8e4998376fc5760496e5e507b5b5e79d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:02,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:02,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e4998376fc5760496e5e507b5b5e79d; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62880528, jitterRate=-0.06300711631774902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:55:02,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e4998376fc5760496e5e507b5b5e79d: Running coprocessor pre-open hook at 1676076902496Writing region info on filesystem at 1676076902496Initializing all the Stores at 1676076902497 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676076902497Cleaning up temporary data from old regions at 1676076902504 (+7 ms)Cleaning up detritus from prior splits at 1676076902505 (+1 ms)Running coprocessor post-open hooks at 1676076902507 (+2 ms)Region opened successfully at 1676076902507 2023-02-11 00:55:02,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., pid=63, masterSystemTime=1676076902493 2023-02-11 00:55:02,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:02,509 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:02,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076902509"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076902509"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076902509"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076902509"}]},"ts":"1676076902509"} 2023-02-11 00:55:02,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-11 00:55:02,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915 in 170 msec 2023-02-11 00:55:02,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-11 00:55:02,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE in 1.0730 sec 2023-02-11 00:55:02,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-11 00:55:02,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0760 sec 2023-02-11 00:55:02,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4910 sec 2023-02-11 00:55:02,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-11 00:55:02,517 INFO [Listener at localhost/36341] compactions.TestMobCompactor(278): alter status finished 2023-02-11 00:55:02,518 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:55:02,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:02,520 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:02,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:02,521 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077502521 2023-02-11 00:55:02,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:55:02,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 00:55:02,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:02,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x0cd9cda4 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:02,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a8b5775, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:02,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:02,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:02,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:02,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:02,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:03,349 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cde35b9dfda144699c66f7d49e35ae0e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128cde35b9dfda144699c66f7d49e35ae0e 2023-02-11 00:55:03,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:03,362 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:03,363 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:03,369 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:03,370 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:03,377 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71fc82a8911d491f9c3945f939f961dc first=Optional[r05] last=Optional[r8] 2023-02-11 00:55:03,378 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71fc82a8911d491f9c3945f939f961dc}] 2023-02-11 00:55:03,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71fc82a8911d491f9c3945f939f961dc for inclusion in 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:03,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 00:55:03,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:55:03,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 8e4998376fc5760496e5e507b5b5e79d: 2023-02-11 00:55:03,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71fc82a8911d491f9c3945f939f961dc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ni5j4g16v4p53cq5v95gqei7dif3nsb4nqb18p8nco8ql1pf0hpo1bgro9b3g53v/family1/71fc82a8911d491f9c3945f939f961dc 2023-02-11 00:55:03,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ni5j4g16v4p53cq5v95gqei7dif3nsb4nqb18p8nco8ql1pf0hpo1bgro9b3g53v/family1/71fc82a8911d491f9c3945f939f961dc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/dae115c1044843b0946d859280873221_SeqId_53_ 2023-02-11 00:55:03,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ni5j4g16v4p53cq5v95gqei7dif3nsb4nqb18p8nco8ql1pf0hpo1bgro9b3g53v/family1/71fc82a8911d491f9c3945f939f961dc into 8e4998376fc5760496e5e507b5b5e79d/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/dae115c1044843b0946d859280873221_SeqId_53_ - updating store file list. 2023-02-11 00:55:03,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/dae115c1044843b0946d859280873221_SeqId_53_ into 8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:03,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ni5j4g16v4p53cq5v95gqei7dif3nsb4nqb18p8nco8ql1pf0hpo1bgro9b3g53v/family1/71fc82a8911d491f9c3945f939f961dc into 8e4998376fc5760496e5e507b5b5e79d/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/dae115c1044843b0946d859280873221_SeqId_53_) 2023-02-11 00:55:03,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ni5j4g16v4p53cq5v95gqei7dif3nsb4nqb18p8nco8ql1pf0hpo1bgro9b3g53v/family1/71fc82a8911d491f9c3945f939f961dc 2023-02-11 00:55:03,392 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:03,393 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:03,394 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f1db1dc19702449eb51bbf9d543bb53c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f1db1dc19702449eb51bbf9d543bb53c 2023-02-11 00:55:03,395 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128865397cc01cf456db6116a247758c19c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128865397cc01cf456db6116a247758c19c 2023-02-11 00:55:03,395 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-11 00:55:03,395 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 00:55:03,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:03,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:03,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:03,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:03,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:03,396 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:03,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 877 msec 2023-02-11 00:55:03,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-11 00:55:03,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:55:03,854 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 00:55:03,855 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 00:55:03,855 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 00:55:03,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 00:55:03,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE}] 2023-02-11 00:55:03,860 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE 2023-02-11 00:55:03,861 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:03,861 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076903861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076903861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076903861"}]},"ts":"1676076903861"} 2023-02-11 00:55:03,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:04,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e4998376fc5760496e5e507b5b5e79d, disabling compactions & flushes 2023-02-11 00:55:04,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. after waiting 0 ms 2023-02-11 00:55:04,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 00:55:04,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e4998376fc5760496e5e507b5b5e79d: Waiting for close lock at 1676076904014Running coprocessor pre-close hooks at 1676076904014Disabling compacts and flushes for region at 1676076904014Disabling writes for close at 1676076904014Writing region close event to WAL at 1676076904018 (+4 ms)Running coprocessor post-close hooks at 1676076904022 (+4 ms)Closed at 1676076904022 2023-02-11 00:55:04,022 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8e4998376fc5760496e5e507b5b5e79d to self. 2023-02-11 00:55:04,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,023 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=CLOSED 2023-02-11 00:55:04,024 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076904023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076904023"}]},"ts":"1676076904023"} 2023-02-11 00:55:04,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-11 00:55:04,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915 in 163 msec 2023-02-11 00:55:04,026 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=true 2023-02-11 00:55:04,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:04,177 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076904176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076904176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076904176"}]},"ts":"1676076904176"} 2023-02-11 00:55:04,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:04,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e4998376fc5760496e5e507b5b5e79d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:55:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,333 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,334 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:04,334 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1 2023-02-11 00:55:04,335 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e4998376fc5760496e5e507b5b5e79d columnFamilyName family1 2023-02-11 00:55:04,339 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/b3f94a5b627e4a4697c680c8af80b1b7 2023-02-11 00:55:04,342 DEBUG [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/family1/dae115c1044843b0946d859280873221_SeqId_53_ 2023-02-11 00:55:04,342 INFO [StoreOpener-8e4998376fc5760496e5e507b5b5e79d-1] regionserver.HStore(310): Store=8e4998376fc5760496e5e507b5b5e79d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:55:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e4998376fc5760496e5e507b5b5e79d; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62965093, jitterRate=-0.061746999621391296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:55:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e4998376fc5760496e5e507b5b5e79d: Running coprocessor pre-open hook at 1676076904332Writing region info on filesystem at 1676076904332Initializing all the Stores at 1676076904333 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676076904333Cleaning up temporary data from old regions at 1676076904344 (+11 ms)Cleaning up detritus from prior splits at 1676076904345 (+1 ms)Running coprocessor post-open hooks at 1676076904347 (+2 ms)Region opened successfully at 1676076904347 2023-02-11 00:55:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d., pid=69, masterSystemTime=1676076904329 2023-02-11 00:55:04,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:55:04,349 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8e4998376fc5760496e5e507b5b5e79d, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:04,349 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676076904349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076904349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076904349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076904349"}]},"ts":"1676076904349"} 2023-02-11 00:55:04,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-11 00:55:04,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8e4998376fc5760496e5e507b5b5e79d, server=jenkins-hbase4.apache.org,43697,1676076813915 in 172 msec 2023-02-11 00:55:04,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-11 00:55:04,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8e4998376fc5760496e5e507b5b5e79d, REOPEN/MOVE in 491 msec 2023-02-11 00:55:04,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-11 00:55:04,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 496 msec 2023-02-11 00:55:04,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 909 msec 2023-02-11 00:55:04,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-11 00:55:04,357 INFO [Listener at localhost/36341] compactions.TestMobCompactor(278): alter status finished 2023-02-11 00:55:04,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 00:55:04,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:04,359 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:04,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:04,360 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077504360 2023-02-11 00:55:04,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:55:04,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 00:55:04,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:04,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x180e5e7f to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:04,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78fd2952, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 00:55:04,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 00:55:04,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:04,367 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 00:55:04,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-02-11 00:55:04,420 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251 (was 242) - Thread LEAK? -, OpenFileDescriptor=642 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 202), ProcessCount=168 (was 168), AvailableMemoryMB=3111 (was 3120) 2023-02-11 00:55:04,431 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=168, AvailableMemoryMB=3111 2023-02-11 00:55:04,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 00:55:04,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:04,435 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:55:04,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-11 00:55:04,435 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:55:04,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:04,436 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:04,437 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 empty. 2023-02-11 00:55:04,437 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:04,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 00:55:04,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:04,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:04,844 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:04,846 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2e8aa38ae4d08c57a345197c481f1538, NAME => 'testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:05,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 2e8aa38ae4d08c57a345197c481f1538, disabling compactions & flushes 2023-02-11 00:55:05,251 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. after waiting 0 ms 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,251 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,251 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 2e8aa38ae4d08c57a345197c481f1538: Waiting for close lock at 1676076905251Disabling compacts and flushes for region at 1676076905251Disabling writes for close at 1676076905251Writing region close event to WAL at 1676076905251Closed at 1676076905251 2023-02-11 00:55:05,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:55:05,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676076905254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076905254"}]},"ts":"1676076905254"} 2023-02-11 00:55:05,255 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:55:05,256 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:55:05,256 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076905256"}]},"ts":"1676076905256"} 2023-02-11 00:55:05,257 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-11 00:55:05,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, ASSIGN}] 2023-02-11 00:55:05,261 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, ASSIGN 2023-02-11 00:55:05,261 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:05,412 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2e8aa38ae4d08c57a345197c481f1538, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:05,412 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676076905412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076905412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076905412"}]},"ts":"1676076905412"} 2023-02-11 00:55:05,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 2e8aa38ae4d08c57a345197c481f1538, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:05,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:05,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2e8aa38ae4d08c57a345197c481f1538, NAME => 'testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:55:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-11 00:55:05,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-11 00:55:05,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:05,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,571 INFO [StoreOpener-2e8aa38ae4d08c57a345197c481f1538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,572 DEBUG [StoreOpener-2e8aa38ae4d08c57a345197c481f1538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1 2023-02-11 00:55:05,572 DEBUG [StoreOpener-2e8aa38ae4d08c57a345197c481f1538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1 2023-02-11 00:55:05,572 INFO [StoreOpener-2e8aa38ae4d08c57a345197c481f1538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e8aa38ae4d08c57a345197c481f1538 columnFamilyName f1 2023-02-11 00:55:05,573 INFO [StoreOpener-2e8aa38ae4d08c57a345197c481f1538-1] regionserver.HStore(310): Store=2e8aa38ae4d08c57a345197c481f1538/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:05,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:05,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:05,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2e8aa38ae4d08c57a345197c481f1538; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61154036, jitterRate=-0.08873385190963745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:55:05,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2e8aa38ae4d08c57a345197c481f1538: Running coprocessor pre-open hook at 1676076905570Writing region info on filesystem at 1676076905570Initializing all the Stores at 1676076905570Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076905570Cleaning up temporary data from old regions at 1676076905575 (+5 ms)Cleaning up detritus from prior splits at 1676076905575Running coprocessor post-open hooks at 1676076905579 (+4 ms)Region opened successfully at 1676076905579 2023-02-11 00:55:05,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538., pid=73, masterSystemTime=1676076905565 2023-02-11 00:55:05,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:05,581 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2e8aa38ae4d08c57a345197c481f1538, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:05,581 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676076905581"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076905581"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076905581"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076905581"}]},"ts":"1676076905581"} 2023-02-11 00:55:05,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-11 00:55:05,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 2e8aa38ae4d08c57a345197c481f1538, server=jenkins-hbase4.apache.org,43697,1676076813915 in 169 msec 2023-02-11 00:55:05,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-11 00:55:05,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, ASSIGN in 325 msec 2023-02-11 00:55:05,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:55:05,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076905586"}]},"ts":"1676076905586"} 2023-02-11 00:55:05,587 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-11 00:55:05,589 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:55:05,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-02-11 00:55:05,847 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-11 00:55:06,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 00:55:06,540 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-11 00:55:06,540 DEBUG [Listener at localhost/36341] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-11 00:55:06,542 INFO [Listener at localhost/36341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 00:55:06,545 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-11 00:55:06,545 INFO [Listener at localhost/36341] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 00:55:06,545 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-11 00:55:06,549 INFO [Listener at localhost/36341] regionserver.HRegion(2744): Flushing 2e8aa38ae4d08c57a345197c481f1538 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 00:55:06,961 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211af72c2dc96d54aa5bec11c69cb0fd243 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211af72c2dc96d54aa5bec11c69cb0fd243 2023-02-11 00:55:07,366 INFO [Listener at localhost/36341] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp/f1/efcbee2c1e0d4130aada4d5a9988fa2f 2023-02-11 00:55:07,371 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp/f1/efcbee2c1e0d4130aada4d5a9988fa2f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f 2023-02-11 00:55:07,374 INFO [Listener at localhost/36341] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 00:55:07,375 INFO [Listener at localhost/36341] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 2e8aa38ae4d08c57a345197c481f1538 in 826ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:07,376 DEBUG [Listener at localhost/36341] regionserver.HRegion(2445): Flush status journal for 2e8aa38ae4d08c57a345197c481f1538: 2023-02-11 00:55:07,378 INFO [Listener at localhost/36341] regionserver.HRegion(2744): Flushing 2e8aa38ae4d08c57a345197c481f1538 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 00:55:07,726 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:55:07,789 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211fccac00ae9d9420bb95617818751e3c4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211fccac00ae9d9420bb95617818751e3c4 2023-02-11 00:55:08,194 INFO [Listener at localhost/36341] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp/f1/36ab2932c8c94de38f796b6b21abfda8 2023-02-11 00:55:08,198 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp/f1/36ab2932c8c94de38f796b6b21abfda8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8 2023-02-11 00:55:08,201 INFO [Listener at localhost/36341] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8, entries=1, sequenceid=9, filesize=4.9 K 2023-02-11 00:55:08,202 INFO [Listener at localhost/36341] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 2e8aa38ae4d08c57a345197c481f1538 in 824ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:08,202 DEBUG [Listener at localhost/36341] regionserver.HRegion(2445): Flush status journal for 2e8aa38ae4d08c57a345197c481f1538: 2023-02-11 00:55:08,203 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-11 00:55:08,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 00:55:08,205 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 00:55:08,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:08,206 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077508206 2023-02-11 00:55:08,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:55:08,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-11 00:55:08,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-11 00:55:08,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x44f81acd to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:08,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55de1cb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:08,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 00:55:08,255 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,255 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,305 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,306 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,356 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,356 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,407 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,407 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,458 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,458 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,508 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,509 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,559 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,559 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,610 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,610 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,661 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,661 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,711 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,711 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,762 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,762 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,813 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,813 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,864 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,864 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,915 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,915 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,966 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:08,966 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,016 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,017 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,034 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211bc1b157e809c4872af2d724a25b33663 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211bc1b157e809c4872af2d724a25b33663 2023-02-11 00:55:09,035 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 00:55:09,048 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:09,050 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:09,056 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:09,058 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:09,067 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/bb5bc9c166e64ebab2fb3a33bdece12e first=Optional[r1] last=Optional[r2] 2023-02-11 00:55:09,067 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{f1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/bb5bc9c166e64ebab2fb3a33bdece12e}] 2023-02-11 00:55:09,068 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,068 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/bb5bc9c166e64ebab2fb3a33bdece12e for inclusion in 2e8aa38ae4d08c57a345197c481f1538/f1 2023-02-11 00:55:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 00:55:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:55:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 2e8aa38ae4d08c57a345197c481f1538: 2023-02-11 00:55:09,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/bb5bc9c166e64ebab2fb3a33bdece12e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testGetAfterCompaction__91maa070nqqoaqu6kk3qirimlklpjvd34kr48n2d3ov1tg2cvtj6cpunt0f2mft7/f1/bb5bc9c166e64ebab2fb3a33bdece12e 2023-02-11 00:55:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testGetAfterCompaction__91maa070nqqoaqu6kk3qirimlklpjvd34kr48n2d3ov1tg2cvtj6cpunt0f2mft7/f1/bb5bc9c166e64ebab2fb3a33bdece12e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_ 2023-02-11 00:55:09,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testGetAfterCompaction__91maa070nqqoaqu6kk3qirimlklpjvd34kr48n2d3ov1tg2cvtj6cpunt0f2mft7/f1/bb5bc9c166e64ebab2fb3a33bdece12e into 2e8aa38ae4d08c57a345197c481f1538/f1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_ - updating store file list. 2023-02-11 00:55:09,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_ into 2e8aa38ae4d08c57a345197c481f1538/f1 2023-02-11 00:55:09,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testGetAfterCompaction__91maa070nqqoaqu6kk3qirimlklpjvd34kr48n2d3ov1tg2cvtj6cpunt0f2mft7/f1/bb5bc9c166e64ebab2fb3a33bdece12e into 2e8aa38ae4d08c57a345197c481f1538/f1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_) 2023-02-11 00:55:09,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testGetAfterCompaction__91maa070nqqoaqu6kk3qirimlklpjvd34kr48n2d3ov1tg2cvtj6cpunt0f2mft7/f1/bb5bc9c166e64ebab2fb3a33bdece12e 2023-02-11 00:55:09,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): 2e8aa38ae4d08c57a345197c481f1538/f1 is initiating minor compaction 2023-02-11 00:55:09,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4c890922; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:09,083 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2e8aa38ae4d08c57a345197c481f1538/f1 in testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:09,083 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp, totalSize=10.0 K 2023-02-11 00:55:09,083 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 36ab2932c8c94de38f796b6b21abfda8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:55:09,083 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 26dd254b637248c9b6484668486c0da7_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:55:09,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 00:55:09,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:09,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211af72c2dc96d54aa5bec11c69cb0fd243 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211af72c2dc96d54aa5bec11c69cb0fd243 2023-02-11 00:55:09,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211fccac00ae9d9420bb95617818751e3c4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211fccac00ae9d9420bb95617818751e3c4 2023-02-11 00:55:09,090 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-11 00:55:09,090 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 00:55:09,090 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 00:55:09,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-11 00:55:09,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:55:09,091 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 00:55:09,093 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2e8aa38ae4d08c57a345197c481f1538#f1#compaction#76 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:09,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 887 msec 2023-02-11 00:55:09,119 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,119 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,119 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,122 DEBUG [Listener at localhost/36341] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 00:55:09,126 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 00:55:09,126 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43697] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:09,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-11 00:55:09,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 00:55:09,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43697] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 00:55:09,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43697] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. because compaction request was cancelled 2023-02-11 00:55:09,179 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,179 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,179 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,230 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,230 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,230 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,281 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,281 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,281 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,331 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,332 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,332 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,382 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,383 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,383 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,433 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,433 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,434 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,484 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,484 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,484 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,535 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,535 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,535 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,586 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,586 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,586 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,637 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,637 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,637 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,688 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,688 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,688 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,738 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,739 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,739 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,789 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,789 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,789 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,840 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,840 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,840 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,891 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,891 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,891 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,906 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/.tmp/f1/000095c0d8684e2e94ae68cec5220b22 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/000095c0d8684e2e94ae68cec5220b22 2023-02-11 00:55:09,911 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 2e8aa38ae4d08c57a345197c481f1538/f1 of 2e8aa38ae4d08c57a345197c481f1538 into 000095c0d8684e2e94ae68cec5220b22(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:55:09,911 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2e8aa38ae4d08c57a345197c481f1538: 2023-02-11 00:55:09,911 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676076909083; duration=0sec 2023-02-11 00:55:09,911 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:09,942 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/000095c0d8684e2e94ae68cec5220b22; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676076909902; access_time=1676076909090; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,942 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676076909031; access_time=1676076908223; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 00:55:09,942 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076908193; access_time=1676076907380; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,942 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_] to archive 2023-02-11 00:55:09,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:09,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/36ab2932c8c94de38f796b6b21abfda8 2023-02-11 00:55:09,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/26dd254b637248c9b6484668486c0da7_SeqId_12_ 2023-02-11 00:55:09,992 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/000095c0d8684e2e94ae68cec5220b22; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676076909902; access_time=1676076909090; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:09,992 INFO [Listener at localhost/36341] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676076907365; access_time=1676076906552; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 00:55:10,107 INFO [Listener at localhost/36341] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-11 00:55:10,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-11 00:55:10,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,120 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076910120"}]},"ts":"1676076910120"} 2023-02-11 00:55:10,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 00:55:10,121 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-11 00:55:10,122 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-11 00:55:10,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, UNASSIGN}] 2023-02-11 00:55:10,125 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, UNASSIGN 2023-02-11 00:55:10,125 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2e8aa38ae4d08c57a345197c481f1538, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:10,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676076910125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076910125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076910125"}]},"ts":"1676076910125"} 2023-02-11 00:55:10,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 2e8aa38ae4d08c57a345197c481f1538, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:10,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 00:55:10,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:10,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2e8aa38ae4d08c57a345197c481f1538, disabling compactions & flushes 2023-02-11 00:55:10,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:10,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:10,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. after waiting 0 ms 2023-02-11 00:55:10,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:10,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 00:55:10,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-11 00:55:10,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538. 2023-02-11 00:55:10,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2e8aa38ae4d08c57a345197c481f1538: Waiting for close lock at 1676076910278Running coprocessor pre-close hooks at 1676076910278Disabling compacts and flushes for region at 1676076910278Disabling writes for close at 1676076910278Writing region close event to WAL at 1676076910279 (+1 ms)Running coprocessor post-close hooks at 1676076910283 (+4 ms)Closed at 1676076910284 (+1 ms) 2023-02-11 00:55:10,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:10,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2e8aa38ae4d08c57a345197c481f1538, regionState=CLOSED 2023-02-11 00:55:10,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676076910286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076910286"}]},"ts":"1676076910286"} 2023-02-11 00:55:10,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-11 00:55:10,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 2e8aa38ae4d08c57a345197c481f1538, server=jenkins-hbase4.apache.org,43697,1676076813915 in 160 msec 2023-02-11 00:55:10,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-11 00:55:10,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=2e8aa38ae4d08c57a345197c481f1538, UNASSIGN in 164 msec 2023-02-11 00:55:10,290 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076910290"}]},"ts":"1676076910290"} 2023-02-11 00:55:10,291 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-11 00:55:10,292 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-11 00:55:10,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 180 msec 2023-02-11 00:55:10,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 00:55:10,423 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-11 00:55:10,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-11 00:55:10,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,435 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,436 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 00:55:10,439 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:10,441 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1, FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/recovered.edits] 2023-02-11 00:55:10,444 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/000095c0d8684e2e94ae68cec5220b22 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/000095c0d8684e2e94ae68cec5220b22 2023-02-11 00:55:10,445 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/f1/efcbee2c1e0d4130aada4d5a9988fa2f 2023-02-11 00:55:10,448 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/recovered.edits/15.seqid to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538/recovered.edits/15.seqid 2023-02-11 00:55:10,448 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testGetAfterCompaction/2e8aa38ae4d08c57a345197c481f1538 2023-02-11 00:55:10,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 00:55:10,449 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 00:55:10,449 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-11 00:55:10,451 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211bc1b157e809c4872af2d724a25b33663 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211bc1b157e809c4872af2d724a25b33663 2023-02-11 00:55:10,452 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 00:55:10,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,477 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-11 00:55:10,479 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-11 00:55:10,480 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,480 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-11 00:55:10,480 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676076910480"}]},"ts":"9223372036854775807"} 2023-02-11 00:55:10,482 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 00:55:10,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2e8aa38ae4d08c57a345197c481f1538, NAME => 'testGetAfterCompaction,,1676076904433.2e8aa38ae4d08c57a345197c481f1538.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 00:55:10,482 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-11 00:55:10,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676076910482"}]},"ts":"9223372036854775807"} 2023-02-11 00:55:10,483 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-11 00:55:10,489 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 00:55:10,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 61 msec 2023-02-11 00:55:10,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 00:55:10,538 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-11 00:55:10,551 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=253 (was 251) - Thread LEAK? -, OpenFileDescriptor=639 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 153), ProcessCount=168 (was 168), AvailableMemoryMB=3100 (was 3111) 2023-02-11 00:55:10,561 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=253, OpenFileDescriptor=639, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=168, AvailableMemoryMB=3099 2023-02-11 00:55:10,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 00:55:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-11 00:55:10,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:55:10,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-11 00:55:10,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:55:10,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:10,567 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:10,567 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:10,567 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 empty. 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f empty. 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd empty. 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:10,568 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:10,569 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-11 00:55:10,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:10,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:10,979 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:10,980 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => b43278b0748bb249ee9de5ea2a2e7a01, NAME => 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:10,980 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 023ae0c28a4f9953fdcf7c55b19f9acd, NAME => 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:10,981 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => cc1065bd3f43e44e7e6d2a0b5c404d8f, NAME => 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:11,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing b43278b0748bb249ee9de5ea2a2e7a01, disabling compactions & flushes 2023-02-11 00:55:11,390 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. after waiting 0 ms 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,390 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,390 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for b43278b0748bb249ee9de5ea2a2e7a01: Waiting for close lock at 1676076911390Disabling compacts and flushes for region at 1676076911390Disabling writes for close at 1676076911390Writing region close event to WAL at 1676076911390Closed at 1676076911390 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing cc1065bd3f43e44e7e6d2a0b5c404d8f, disabling compactions & flushes 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 023ae0c28a4f9953fdcf7c55b19f9acd, disabling compactions & flushes 2023-02-11 00:55:11,396 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,396 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. after waiting 0 ms 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. after waiting 0 ms 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,396 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,396 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: Waiting for close lock at 1676076911396Disabling compacts and flushes for region at 1676076911396Disabling writes for close at 1676076911396Writing region close event to WAL at 1676076911396Closed at 1676076911396 2023-02-11 00:55:11,396 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 023ae0c28a4f9953fdcf7c55b19f9acd: Waiting for close lock at 1676076911396Disabling compacts and flushes for region at 1676076911396Disabling writes for close at 1676076911396Writing region close event to WAL at 1676076911396Closed at 1676076911396 2023-02-11 00:55:11,398 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:55:11,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076911399"}]},"ts":"1676076911399"} 2023-02-11 00:55:11,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076911399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076911399"}]},"ts":"1676076911399"} 2023-02-11 00:55:11,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076911399"}]},"ts":"1676076911399"} 2023-02-11 00:55:11,401 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 00:55:11,402 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:55:11,402 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076911402"}]},"ts":"1676076911402"} 2023-02-11 00:55:11,403 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 00:55:11,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN}] 2023-02-11 00:55:11,408 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN 2023-02-11 00:55:11,408 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN 2023-02-11 00:55:11,408 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN 2023-02-11 00:55:11,409 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:11,409 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:11,409 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:11,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,560 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,561 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076911560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076911560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076911560"}]},"ts":"1676076911560"} 2023-02-11 00:55:11,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076911560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076911560"}]},"ts":"1676076911560"} 2023-02-11 00:55:11,561 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076911560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076911560"}]},"ts":"1676076911560"} 2023-02-11 00:55:11,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:11,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:11,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:11,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:11,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cc1065bd3f43e44e7e6d2a0b5c404d8f, NAME => 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 00:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,719 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,720 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:11,720 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:11,721 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1065bd3f43e44e7e6d2a0b5c404d8f columnFamilyName family1 2023-02-11 00:55:11,722 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(310): Store=cc1065bd3f43e44e7e6d2a0b5c404d8f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,722 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,723 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 2023-02-11 00:55:11,723 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 2023-02-11 00:55:11,723 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1065bd3f43e44e7e6d2a0b5c404d8f columnFamilyName family2 2023-02-11 00:55:11,724 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(310): Store=cc1065bd3f43e44e7e6d2a0b5c404d8f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:11,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:11,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cc1065bd3f43e44e7e6d2a0b5c404d8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59830428, jitterRate=-0.10845714807510376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:11,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: Running coprocessor pre-open hook at 1676076911718Writing region info on filesystem at 1676076911718Initializing all the Stores at 1676076911719 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911719Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911719Cleaning up temporary data from old regions at 1676076911726 (+7 ms)Cleaning up detritus from prior splits at 1676076911726Running coprocessor post-open hooks at 1676076911729 (+3 ms)Region opened successfully at 1676076911729 2023-02-11 00:55:11,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., pid=83, masterSystemTime=1676076911715 2023-02-11 00:55:11,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:11,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 023ae0c28a4f9953fdcf7c55b19f9acd, NAME => 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 00:55:11,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076911731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076911731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076911731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076911731"}]},"ts":"1676076911731"} 2023-02-11 00:55:11,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,733 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,734 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:11,734 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:11,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-02-11 00:55:11,734 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 023ae0c28a4f9953fdcf7c55b19f9acd columnFamilyName family1 2023-02-11 00:55:11,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 171 msec 2023-02-11 00:55:11,735 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(310): Store=023ae0c28a4f9953fdcf7c55b19f9acd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN in 329 msec 2023-02-11 00:55:11,735 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,736 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2 2023-02-11 00:55:11,736 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2 2023-02-11 00:55:11,736 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 023ae0c28a4f9953fdcf7c55b19f9acd columnFamilyName family2 2023-02-11 00:55:11,737 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(310): Store=023ae0c28a4f9953fdcf7c55b19f9acd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:11,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:11,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:11,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 023ae0c28a4f9953fdcf7c55b19f9acd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70327276, jitterRate=0.04795807600021362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:11,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 023ae0c28a4f9953fdcf7c55b19f9acd: Running coprocessor pre-open hook at 1676076911732Writing region info on filesystem at 1676076911732Initializing all the Stores at 1676076911732Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911732Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911733 (+1 ms)Cleaning up temporary data from old regions at 1676076911739 (+6 ms)Cleaning up detritus from prior splits at 1676076911739Running coprocessor post-open hooks at 1676076911742 (+3 ms)Region opened successfully at 1676076911742 2023-02-11 00:55:11,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., pid=85, masterSystemTime=1676076911715 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:11,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b43278b0748bb249ee9de5ea2a2e7a01, NAME => 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 00:55:11,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076911744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076911744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076911744"}]},"ts":"1676076911744"} 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,745 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,746 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:11,746 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:11,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-11 00:55:11,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915 in 182 msec 2023-02-11 00:55:11,747 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43278b0748bb249ee9de5ea2a2e7a01 columnFamilyName family1 2023-02-11 00:55:11,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN in 339 msec 2023-02-11 00:55:11,748 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(310): Store=b43278b0748bb249ee9de5ea2a2e7a01/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,748 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,749 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2 2023-02-11 00:55:11,749 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2 2023-02-11 00:55:11,749 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43278b0748bb249ee9de5ea2a2e7a01 columnFamilyName family2 2023-02-11 00:55:11,750 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(310): Store=b43278b0748bb249ee9de5ea2a2e7a01/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:11,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:11,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:11,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:11,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b43278b0748bb249ee9de5ea2a2e7a01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74620891, jitterRate=0.11193792521953583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:11,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b43278b0748bb249ee9de5ea2a2e7a01: Running coprocessor pre-open hook at 1676076911744Writing region info on filesystem at 1676076911744Initializing all the Stores at 1676076911745 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911745Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076911745Cleaning up temporary data from old regions at 1676076911752 (+7 ms)Cleaning up detritus from prior splits at 1676076911752Running coprocessor post-open hooks at 1676076911756 (+4 ms)Region opened successfully at 1676076911756 2023-02-11 00:55:11,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., pid=84, masterSystemTime=1676076911715 2023-02-11 00:55:11,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:11,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:11,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076911758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076911758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076911758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076911758"}]},"ts":"1676076911758"} 2023-02-11 00:55:11,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-02-11 00:55:11,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915 in 196 msec 2023-02-11 00:55:11,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-02-11 00:55:11,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN in 355 msec 2023-02-11 00:55:11,762 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:55:11,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076911762"}]},"ts":"1676076911762"} 2023-02-11 00:55:11,763 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 00:55:11,765 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:55:11,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2020 sec 2023-02-11 00:55:11,848 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-11 00:55:12,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 00:55:12,671 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-11 00:55:12,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:12,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:12,700 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:12,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:12,700 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44f81acd to 127.0.0.1:63942 2023-02-11 00:55:12,700 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,705 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x180e5e7f to 127.0.0.1:63942 2023-02-11 00:55:12,705 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,707 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:12,707 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cd9cda4 to 127.0.0.1:63942 2023-02-11 00:55:12,707 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,707 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:12,708 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4684fdaa to 127.0.0.1:63942 2023-02-11 00:55:12,708 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,708 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25c9cfd7 to 127.0.0.1:63942 2023-02-11 00:55:12,708 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,708 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:12,708 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33742772 to 127.0.0.1:63942 2023-02-11 00:55:12,708 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,708 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:12,708 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x039704d9 to 127.0.0.1:63942 2023-02-11 00:55:12,708 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:12,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:12,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 00:55:12,712 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 00:55:12,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:12,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 00:55:12,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 00:55:12,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:12,712 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:12,714 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:12,714 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:12,714 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:12,714 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:12,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:12,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 00:55:12,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 00:55:12,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 00:55:12,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:12,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 00:55:12,715 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:12,715 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:12,715 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:12,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:12,716 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:12,716 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:12,716 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:12,716 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b43278b0748bb249ee9de5ea2a2e7a01 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:12,716 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc1065bd3f43e44e7e6d2a0b5c404d8f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:12,716 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:12,717 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 023ae0c28a4f9953fdcf7c55b19f9acd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:13,135 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 2023-02-11 00:55:13,136 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a 2023-02-11 00:55:13,136 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e 2023-02-11 00:55:13,146 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/a030230415a74159860fa283bc3c028a 2023-02-11 00:55:13,541 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/d6ae4ebf39b94193899e1b35e991e82d 2023-02-11 00:55:13,545 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/4626a1d7b41b468a84359d1976dc4b73 2023-02-11 00:55:13,560 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c 2023-02-11 00:55:13,955 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b 2023-02-11 00:55:13,958 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526 2023-02-11 00:55:13,962 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/34758606a35744c9817c20d195ee8866 2023-02-11 00:55:13,964 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/7b6e3545312d4eca94b9645ba9054834 2023-02-11 00:55:13,966 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/4626a1d7b41b468a84359d1976dc4b73 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73 2023-02-11 00:55:13,968 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/a030230415a74159860fa283bc3c028a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a 2023-02-11 00:55:13,970 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:13,970 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/34758606a35744c9817c20d195ee8866 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866 2023-02-11 00:55:13,971 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:13,972 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/7b6e3545312d4eca94b9645ba9054834 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834 2023-02-11 00:55:13,977 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:13,978 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 023ae0c28a4f9953fdcf7c55b19f9acd in 1261ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:13,979 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:13,979 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:13,979 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:13,980 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:13,981 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b43278b0748bb249ee9de5ea2a2e7a01 in 1265ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:13,981 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:13,981 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:13,981 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:14,360 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 2023-02-11 00:55:14,364 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/d6ae4ebf39b94193899e1b35e991e82d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d 2023-02-11 00:55:14,368 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:14,368 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 2023-02-11 00:55:14,372 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:14,372 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cc1065bd3f43e44e7e6d2a0b5c404d8f in 1656ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:14,372 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:14,372 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:14,373 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:14,373 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:14,373 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,373 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 00:55:14,373 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 00:55:14,374 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,374 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:14,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:14,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:14,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:14,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 00:55:14,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e8591c9[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:14,376 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 00:55:14,377 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,378 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 00:55:14,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 00:55:14,378 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:14,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:14,379 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 00:55:14,379 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,379 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:14,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:14,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:14,379 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 00:55:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:14,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:14,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:14,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 00:55:14,382 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 00:55:14,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:14,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:14,382 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 00:55:14,382 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:14,385 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,385 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:14,385 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,386 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:14,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,387 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:14,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 00:55:14,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:14,389 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:14,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 00:55:14,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:14,389 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,390 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,390 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:14,390 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,490 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:14,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:14,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:14,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:14,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:14,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:14,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 00:55:14,496 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 00:55:14,496 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:14,496 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 00:55:14,496 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 00:55:14,497 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,497 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:14,498 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:14,498 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:14,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:14,498 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:14,498 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:14,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:14,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:14,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:14,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:14,499 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 00:55:14,499 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 00:55:14,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 00:55:14,500 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 00:55:14,500 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:14,500 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 00:55:14,504 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:14,504 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:14,504 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:14,504 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:14,504 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b43278b0748bb249ee9de5ea2a2e7a01 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:14,504 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 023ae0c28a4f9953fdcf7c55b19f9acd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:14,505 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:14,505 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:14,505 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:14,505 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:14,506 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc1065bd3f43e44e7e6d2a0b5c404d8f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:14,930 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 2023-02-11 00:55:14,930 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 2023-02-11 00:55:14,936 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 2023-02-11 00:55:15,335 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/e802e0b003d448929a1a2419211b2d70 2023-02-11 00:55:15,335 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/ecae5951760a4fc3b122d460705fe026 2023-02-11 00:55:15,340 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/fadc1cb32e91426e8c30a0e692753945 2023-02-11 00:55:15,751 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5 2023-02-11 00:55:15,751 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869 2023-02-11 00:55:15,753 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2 2023-02-11 00:55:15,785 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:55:16,161 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/1009e21fa89b40b9b2c69ed075368ca2 2023-02-11 00:55:16,161 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/054fdb4bc4554831a1aaa6ae48df102b 2023-02-11 00:55:16,162 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/39edbd4aaa8e41189f90c5c00830912f 2023-02-11 00:55:16,166 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/e802e0b003d448929a1a2419211b2d70 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70 2023-02-11 00:55:16,166 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/fadc1cb32e91426e8c30a0e692753945 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945 2023-02-11 00:55:16,167 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/ecae5951760a4fc3b122d460705fe026 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026 2023-02-11 00:55:16,169 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:16,169 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:16,170 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/1009e21fa89b40b9b2c69ed075368ca2 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2 2023-02-11 00:55:16,170 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/39edbd4aaa8e41189f90c5c00830912f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f 2023-02-11 00:55:16,170 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:16,171 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/054fdb4bc4554831a1aaa6ae48df102b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b 2023-02-11 00:55:16,174 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:16,174 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:16,174 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:16,175 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 023ae0c28a4f9953fdcf7c55b19f9acd in 1671ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:16,175 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b43278b0748bb249ee9de5ea2a2e7a01 in 1671ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:16,175 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cc1065bd3f43e44e7e6d2a0b5c404d8f in 1669ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:16,175 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 00:55:16,175 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 00:55:16,177 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,177 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:16,177 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,177 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:16,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:16,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 00:55:16,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c14632e[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:16,178 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 00:55:16,178 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,180 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 00:55:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 00:55:16,180 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,180 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:16,180 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:16,181 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 00:55:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:16,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:16,181 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 00:55:16,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:16,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:16,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:16,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:16,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 00:55:16,183 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 00:55:16,183 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:16,183 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:16,183 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 00:55:16,183 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:16,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:16,186 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:16,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:16,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:16,187 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,188 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:16,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:16,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 00:55:16,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:16,190 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:16,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:16,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 00:55:16,190 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:16,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:16,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:16,291 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:16,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:16,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:16,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:16,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:16,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 00:55:16,297 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 00:55:16,297 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:16,297 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 00:55:16,297 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 00:55:16,298 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,298 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:16,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,299 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:16,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:16,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:16,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:16,299 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:16,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:16,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:16,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:16,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:16,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 00:55:16,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 00:55:16,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 00:55:16,300 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 00:55:16,300 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:16,300 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 00:55:16,300 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:16,301 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:16,301 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b43278b0748bb249ee9de5ea2a2e7a01 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:16,301 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:16,301 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:16,301 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 023ae0c28a4f9953fdcf7c55b19f9acd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:16,301 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc1065bd3f43e44e7e6d2a0b5c404d8f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:16,719 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c 2023-02-11 00:55:16,719 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 2023-02-11 00:55:16,719 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c 2023-02-11 00:55:17,136 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/63f40345712541698a8fb8b8027212cf 2023-02-11 00:55:17,136 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/72b7675bdfa847d3a18ad4805361cd7f 2023-02-11 00:55:17,136 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/a1c47e823423480d85e744c0acb7e14b 2023-02-11 00:55:17,553 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50 2023-02-11 00:55:17,553 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c 2023-02-11 00:55:17,553 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863 2023-02-11 00:55:17,560 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/68d4c0df6f32497e9e06d60619a4ba97 2023-02-11 00:55:17,563 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/72b7675bdfa847d3a18ad4805361cd7f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f 2023-02-11 00:55:17,566 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:17,567 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/68d4c0df6f32497e9e06d60619a4ba97 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97 2023-02-11 00:55:17,569 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:17,570 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cc1065bd3f43e44e7e6d2a0b5c404d8f in 1269ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:17,570 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:17,570 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:17,570 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:17,959 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/7d28c9011e8e4a6d866afbb51dc59a6b 2023-02-11 00:55:17,960 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/0f00443bccd446a5b46914a4ef290a1d 2023-02-11 00:55:17,963 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/63f40345712541698a8fb8b8027212cf as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf 2023-02-11 00:55:17,964 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/a1c47e823423480d85e744c0acb7e14b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b 2023-02-11 00:55:17,966 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:17,967 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/7d28c9011e8e4a6d866afbb51dc59a6b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b 2023-02-11 00:55:17,968 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:17,968 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/0f00443bccd446a5b46914a4ef290a1d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d 2023-02-11 00:55:17,971 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:17,972 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:17,972 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 023ae0c28a4f9953fdcf7c55b19f9acd in 1671ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:17,972 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b43278b0748bb249ee9de5ea2a2e7a01 in 1671ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:17,972 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 00:55:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 00:55:17,974 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 00:55:17,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51fade2d[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:17,975 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 00:55:17,975 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,978 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 00:55:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 00:55:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:17,982 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 00:55:17,982 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:17,982 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,982 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 00:55:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:17,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 00:55:17,984 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 00:55:17,984 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:17,984 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:17,984 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 00:55:17,984 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:17,986 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,986 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:17,986 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:17,986 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,988 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:17,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 00:55:17,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:17,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:17,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:17,991 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:17,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:17,992 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:17,992 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:17,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:18,092 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:18,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:18,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:18,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:18,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:18,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:18,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:18,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 00:55:18,098 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 00:55:18,098 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:18,098 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 00:55:18,098 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 00:55:18,099 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:18,099 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:18,100 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:18,100 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:18,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:18,100 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:18,100 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:18,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:18,101 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 00:55:18,101 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 00:55:18,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 00:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 00:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:18,102 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 00:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:18,102 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:18,102 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b43278b0748bb249ee9de5ea2a2e7a01 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:18,102 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 023ae0c28a4f9953fdcf7c55b19f9acd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:18,104 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:18,104 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:18,104 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:18,104 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:18,104 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc1065bd3f43e44e7e6d2a0b5c404d8f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:18,122 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 2023-02-11 00:55:18,123 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a 2023-02-11 00:55:18,525 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 2023-02-11 00:55:18,529 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/f8a467f8c4f246558091682134bb26d1 2023-02-11 00:55:18,531 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/8652069ddf80480f8c63f073a6856362 2023-02-11 00:55:18,549 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e 2023-02-11 00:55:18,554 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/7ca192618f8c4c129d7b09a2543abb28 2023-02-11 00:55:18,557 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/f8a467f8c4f246558091682134bb26d1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1 2023-02-11 00:55:18,560 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:18,561 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/7ca192618f8c4c129d7b09a2543abb28 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28 2023-02-11 00:55:18,564 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:18,565 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 023ae0c28a4f9953fdcf7c55b19f9acd in 463ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:18,565 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:18,929 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/49f23577e1464a5bbe2990b8a6b4ab81 2023-02-11 00:55:18,950 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c 2023-02-11 00:55:19,342 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8 2023-02-11 00:55:19,354 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/c89e59e7afa542968fcb3ab138c8aa29 2023-02-11 00:55:19,357 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/8652069ddf80480f8c63f073a6856362 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362 2023-02-11 00:55:19,360 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:19,361 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/c89e59e7afa542968fcb3ab138c8aa29 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29 2023-02-11 00:55:19,364 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:19,365 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cc1065bd3f43e44e7e6d2a0b5c404d8f in 1261ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:19,365 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:19,365 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:19,365 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:19,747 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/3d6da15792b440cea8f524c14dec2359 2023-02-11 00:55:19,751 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/49f23577e1464a5bbe2990b8a6b4ab81 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81 2023-02-11 00:55:19,754 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:19,755 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/3d6da15792b440cea8f524c14dec2359 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359 2023-02-11 00:55:19,758 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:19,759 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b43278b0748bb249ee9de5ea2a2e7a01 in 1657ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:19,759 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:19,759 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 00:55:19,759 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 00:55:19,761 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:19,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 00:55:19,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ee1753c[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:19,762 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 00:55:19,762 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,763 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,763 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 00:55:19,763 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 00:55:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:19,764 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,764 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:19,768 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,768 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 00:55:19,768 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:19,768 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 00:55:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:19,770 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 00:55:19,770 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:19,770 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:19,770 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 00:55:19,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 00:55:19,770 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:19,771 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,771 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:19,771 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:19,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:19,772 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,773 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:19,775 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:19,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 00:55:19,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:19,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 00:55:19,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:19,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:19,775 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:19,876 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:19,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:19,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:19,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676076919886 (current time:1676076919886). 2023-02-11 00:55:19,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 00:55:19,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] zookeeper.ReadOnlyZKClient(139): Connect 0x28ca3ae6 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:19,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@771548ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:19,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:19,899 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28ca3ae6 to 127.0.0.1:63942 2023-02-11 00:55:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 00:55:19,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:19,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:19,909 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:19,910 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676077519910 2023-02-11 00:55:19,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:19,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676076919877 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 00:55:19,911 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:19,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 00:55:19,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-11 00:55:19,913 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 00:55:19,913 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676077519913 2023-02-11 00:55:19,915 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:19,915 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 00:55:20,015 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:20,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:20,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:20,019 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 00:55:20,219 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:20,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:20,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:20,220 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 00:55:20,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676076919877 2023-02-11 00:55:20,322 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676076919877' 2023-02-11 00:55:20,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 00:55:20,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676076919877' starting 'acquire' 2023-02-11 00:55:20,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676076919877', kicking off acquire phase on members. 2023-02-11 00:55:20,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676076919877 2023-02-11 00:55:20,324 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,324 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 00:55:20,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 00:55:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 00:55:20,324 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,324 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676076919877 2023-02-11 00:55:20,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 00:55:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676076919877 2023-02-11 00:55:20,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676076919877 from table testCompactionWithHFileLink type FLUSH 2023-02-11 00:55:20,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676076919877 2023-02-11 00:55:20,327 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676076919877' with timeout 300000ms 2023-02-11 00:55:20,327 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 00:55:20,327 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676076919877' starting 'acquire' stage 2023-02-11 00:55:20,327 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676076919877' locally acquired 2023-02-11 00:55:20,327 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (snaptb-1676076919877) in zk 2023-02-11 00:55:20,329 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,329 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:20,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 00:55:20,329 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,329 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676076919877' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:20,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:20,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:20,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'snaptb-1676076919877' on coordinator 2023-02-11 00:55:20,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c48a6f0[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:20,330 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676076919877' starting 'in-barrier' execution. 2023-02-11 00:55:20,330 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676076919877' received 'reached' from coordinator. 2023-02-11 00:55:20,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,332 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:20,332 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-11 00:55:20,332 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:20,332 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 00:55:20,332 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:20,333 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:20,334 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.' region-info for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,334 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.' region-info for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,334 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.' region-info for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,339 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 00:55:20,339 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 00:55:20,339 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81] hfiles 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1] hfiles 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362] hfiles 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,342 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,486 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29] hfiles 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28] hfiles 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359] hfiles 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,487 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,488 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359 for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,520 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:20,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:20,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:20,522 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. completed. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. completed. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. completed. 2023-02-11 00:55:20,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-11 00:55:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-11 00:55:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-11 00:55:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-11 00:55:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,899 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676076919877' locally completed 2023-02-11 00:55:20,899 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676076919877' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676076919877' has notified controller of completion 2023-02-11 00:55:20,901 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676076919877' completed. 2023-02-11 00:55:20,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:20,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 00:55:20,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676076919877' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:20,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'snaptb-1676076919877', counting down latch. Waiting for 0 more 2023-02-11 00:55:20,903 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676076919877' execution completed 2023-02-11 00:55:20,903 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:20,903 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:20,903 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676076919877 2023-02-11 00:55:20,903 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676076919877including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 00:55:20,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,904 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 00:55:20,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:20,905 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,906 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676076919877 2023-02-11 00:55:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 00:55:20,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676076919877 2023-02-11 00:55:20,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 00:55:20,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676076919877 because node does not exist (not an error) 2023-02-11 00:55:20,908 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:20,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676076919877 2023-02-11 00:55:20,908 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 00:55:20,909 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676076919877/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:20,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676076919877 2023-02-11 00:55:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 00:55:20,909 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-11 00:55:20,909 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676076919877 2023-02-11 00:55:20,909 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676076919877 2023-02-11 00:55:20,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676076919877 2023-02-11 00:55:20,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-11 00:55:20,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 00:55:20,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8] mob files 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e 2023-02-11 00:55:20,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c 2023-02-11 00:55:20,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 2023-02-11 00:55:20,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 2023-02-11 00:55:20,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2] mob files 2023-02-11 00:55:20,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8 2023-02-11 00:55:20,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2 2023-02-11 00:55:21,022 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:21,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:21,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:21,023 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 00:55:21,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676076919877 2023-02-11 00:55:21,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/snaptb-1676076919877 2023-02-11 00:55:21,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/snaptb-1676076919877 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/snaptb-1676076919877 2023-02-11 00:55:21,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676076919877 of table testCompactionWithHFileLink completed 2023-02-11 00:55:21,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/snaptb-1676076919877 2023-02-11 00:55:21,787 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/snaptb-1676076919877 2023-02-11 00:55:21,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676076919877 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676076919910Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676076921316 (+1406 ms)Consolidate snapshot: snaptb-1676076919877 at 1676076921316Loading Region manifests for snaptb-1676076919877 at 1676076921317 (+1 ms)Writing data manifest for snaptb-1676076919877 at 1676076921326 (+9 ms)Verifying snapshot: snaptb-1676076919877 at 1676076921332 (+6 ms)Snapshot snaptb-1676076919877 of table testCompactionWithHFileLink completed at 1676076921786 (+454 ms) 2023-02-11 00:55:21,788 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 00:55:21,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8770 sec 2023-02-11 00:55:22,023 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:22,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:22,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 00:55:22,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:22,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:22,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 00:55:22,054 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 00:55:22,054 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:22,054 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 00:55:22,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 00:55:22,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:22,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:22,056 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:22,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:22,056 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:22,056 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:22,057 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:22,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:22,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:22,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:22,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 00:55:22,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 00:55:22,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 00:55:22,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:22,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 00:55:22,058 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:22,058 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. started... 2023-02-11 00:55:22,058 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b43278b0748bb249ee9de5ea2a2e7a01 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:22,058 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:22,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. started... 2023-02-11 00:55:22,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:22,059 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 023ae0c28a4f9953fdcf7c55b19f9acd 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:22,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:22,059 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:22,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. started... 2023-02-11 00:55:22,059 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc1065bd3f43e44e7e6d2a0b5c404d8f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:22,879 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/eef3050445264b508544b44cd3b50567 2023-02-11 00:55:22,879 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/70954af4513f408c9ca083b5ad226ce8 2023-02-11 00:55:22,880 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/6813a6bafbc04fb2b0f95b095a6e489b 2023-02-11 00:55:22,883 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70954af4513f408c9ca083b5ad226ce8 2023-02-11 00:55:22,883 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eef3050445264b508544b44cd3b50567 2023-02-11 00:55:22,883 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6813a6bafbc04fb2b0f95b095a6e489b 2023-02-11 00:55:23,696 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/3838850ecc6f4b89af4a3d781fa0b91e 2023-02-11 00:55:23,698 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/28b78e1a16854ffdb547038ec9ca5212 2023-02-11 00:55:23,698 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/999e55619c964ea18dc4581e5742b5bc 2023-02-11 00:55:23,699 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3838850ecc6f4b89af4a3d781fa0b91e 2023-02-11 00:55:23,700 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/70954af4513f408c9ca083b5ad226ce8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8 2023-02-11 00:55:23,702 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 999e55619c964ea18dc4581e5742b5bc 2023-02-11 00:55:23,702 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28b78e1a16854ffdb547038ec9ca5212 2023-02-11 00:55:23,702 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/6813a6bafbc04fb2b0f95b095a6e489b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b 2023-02-11 00:55:23,703 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/eef3050445264b508544b44cd3b50567 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567 2023-02-11 00:55:23,704 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70954af4513f408c9ca083b5ad226ce8 2023-02-11 00:55:23,704 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,705 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/3838850ecc6f4b89af4a3d781fa0b91e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e 2023-02-11 00:55:23,706 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6813a6bafbc04fb2b0f95b095a6e489b 2023-02-11 00:55:23,706 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,707 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eef3050445264b508544b44cd3b50567 2023-02-11 00:55:23,707 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,707 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/999e55619c964ea18dc4581e5742b5bc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc 2023-02-11 00:55:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/28b78e1a16854ffdb547038ec9ca5212 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212 2023-02-11 00:55:23,709 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3838850ecc6f4b89af4a3d781fa0b91e 2023-02-11 00:55:23,709 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,710 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cc1065bd3f43e44e7e6d2a0b5c404d8f in 1651ms, sequenceid=24, compaction requested=true 2023-02-11 00:55:23,710 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:23,710 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:23,710 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:23,711 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 999e55619c964ea18dc4581e5742b5bc 2023-02-11 00:55:23,711 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,711 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28b78e1a16854ffdb547038ec9ca5212 2023-02-11 00:55:23,712 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 00:55:23,712 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b43278b0748bb249ee9de5ea2a2e7a01 in 1654ms, sequenceid=24, compaction requested=true 2023-02-11 00:55:23,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:23,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:23,712 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 023ae0c28a4f9953fdcf7c55b19f9acd in 1653ms, sequenceid=24, compaction requested=true 2023-02-11 00:55:23,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:23,712 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 00:55:23,712 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 00:55:23,715 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:23,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,715 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:23,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 00:55:23,717 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 00:55:23,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33daad44[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:23,717 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,720 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,720 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 00:55:23,720 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 00:55:23,720 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:23,721 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,721 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:23,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 00:55:23,722 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:23,722 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 00:55:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:23,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:23,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:23,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:23,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 00:55:23,724 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 00:55:23,724 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:23,724 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:23,724 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 00:55:23,724 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:23,731 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,731 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:23,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,731 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:23,732 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,733 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 00:55:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:23,735 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 00:55:23,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 00:55:23,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:23,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 00:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:23,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:23,735 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:23,736 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,736 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 00:55:23,736 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 00:55:23,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:23,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:23,736 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:23,736 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:23,836 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:23,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:23,837 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:23,838 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): b43278b0748bb249ee9de5ea2a2e7a01/family1 is initiating major compaction (all files) 2023-02-11 00:55:23,838 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:23,838 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:23,838 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of b43278b0748bb249ee9de5ea2a2e7a01/family1 in testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:23,838 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp, totalSize=26.7 K 2023-02-11 00:55:23,839 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting a030230415a74159860fa283bc3c028a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912677 2023-02-11 00:55:23,839 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting fadc1cb32e91426e8c30a0e692753945, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914491 2023-02-11 00:55:23,839 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting a1c47e823423480d85e744c0acb7e14b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916292 2023-02-11 00:55:23,840 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 49f23577e1464a5bbe2990b8a6b4ab81, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:23,840 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 6813a6bafbc04fb2b0f95b095a6e489b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:23,854 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): b43278b0748bb249ee9de5ea2a2e7a01#family1#compaction#107 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:24,265 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del 2023-02-11 00:55:24,265 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del 2023-02-11 00:55:25,078 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4e46da75e1e47079d898c675ea20c66 2023-02-11 00:55:25,079 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/e4e46da75e1e47079d898c675ea20c66 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/e4e46da75e1e47079d898c675ea20c66 2023-02-11 00:55:25,082 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4e46da75e1e47079d898c675ea20c66 2023-02-11 00:55:25,083 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b43278b0748bb249ee9de5ea2a2e7a01/family1 of b43278b0748bb249ee9de5ea2a2e7a01 into e4e46da75e1e47079d898c675ea20c66(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:25,083 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:25,083 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:25,083 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): b43278b0748bb249ee9de5ea2a2e7a01/family2 is initiating major compaction (all files) 2023-02-11 00:55:25,083 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:25,083 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:25,084 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of b43278b0748bb249ee9de5ea2a2e7a01/family2 in testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:25,084 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp, totalSize=25.4 K 2023-02-11 00:55:25,084 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7b6e3545312d4eca94b9645ba9054834, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912677 2023-02-11 00:55:25,084 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 39edbd4aaa8e41189f90c5c00830912f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914491 2023-02-11 00:55:25,085 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0f00443bccd446a5b46914a4ef290a1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916292 2023-02-11 00:55:25,085 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 3d6da15792b440cea8f524c14dec2359, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:25,085 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 999e55619c964ea18dc4581e5742b5bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:25,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b] to archive 2023-02-11 00:55:25,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:25,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a030230415a74159860fa283bc3c028a 2023-02-11 00:55:25,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/fadc1cb32e91426e8c30a0e692753945 2023-02-11 00:55:25,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/a1c47e823423480d85e744c0acb7e14b 2023-02-11 00:55:25,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/49f23577e1464a5bbe2990b8a6b4ab81 2023-02-11 00:55:25,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/6813a6bafbc04fb2b0f95b095a6e489b 2023-02-11 00:55:25,097 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): b43278b0748bb249ee9de5ea2a2e7a01#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:25,509 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del 2023-02-11 00:55:25,509 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del 2023-02-11 00:55:26,322 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a084f0449c84da8859b01e5ea58791f 2023-02-11 00:55:26,323 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/0a084f0449c84da8859b01e5ea58791f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0a084f0449c84da8859b01e5ea58791f 2023-02-11 00:55:26,326 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a084f0449c84da8859b01e5ea58791f 2023-02-11 00:55:26,327 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b43278b0748bb249ee9de5ea2a2e7a01/family2 of b43278b0748bb249ee9de5ea2a2e7a01 into 0a084f0449c84da8859b01e5ea58791f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:26,327 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:26,327 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:26,327 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 023ae0c28a4f9953fdcf7c55b19f9acd/family1 is initiating major compaction (all files) 2023-02-11 00:55:26,327 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:26,328 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:26,328 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 023ae0c28a4f9953fdcf7c55b19f9acd/family1 in testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:26,328 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp, totalSize=26.7 K 2023-02-11 00:55:26,328 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 4626a1d7b41b468a84359d1976dc4b73, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912700 2023-02-11 00:55:26,328 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting e802e0b003d448929a1a2419211b2d70, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:26,329 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 63f40345712541698a8fb8b8027212cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:26,329 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting f8a467f8c4f246558091682134bb26d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:26,329 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting eef3050445264b508544b44cd3b50567, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:26,338 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 023ae0c28a4f9953fdcf7c55b19f9acd#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:26,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc] to archive 2023-02-11 00:55:26,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:26,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/7b6e3545312d4eca94b9645ba9054834 2023-02-11 00:55:26,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/39edbd4aaa8e41189f90c5c00830912f 2023-02-11 00:55:26,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0f00443bccd446a5b46914a4ef290a1d 2023-02-11 00:55:26,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/3d6da15792b440cea8f524c14dec2359 2023-02-11 00:55:26,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/999e55619c964ea18dc4581e5742b5bc 2023-02-11 00:55:26,746 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del 2023-02-11 00:55:26,746 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del 2023-02-11 00:55:27,559 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb764f46d1d04470a46e62440e99726f 2023-02-11 00:55:27,559 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/fb764f46d1d04470a46e62440e99726f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/fb764f46d1d04470a46e62440e99726f 2023-02-11 00:55:27,563 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb764f46d1d04470a46e62440e99726f 2023-02-11 00:55:27,563 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 023ae0c28a4f9953fdcf7c55b19f9acd/family1 of 023ae0c28a4f9953fdcf7c55b19f9acd into fb764f46d1d04470a46e62440e99726f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:27,563 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:27,564 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:27,564 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 023ae0c28a4f9953fdcf7c55b19f9acd/family2 is initiating major compaction (all files) 2023-02-11 00:55:27,564 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:27,564 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:27,564 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 023ae0c28a4f9953fdcf7c55b19f9acd/family2 in testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:27,564 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp, totalSize=25.4 K 2023-02-11 00:55:27,564 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 34758606a35744c9817c20d195ee8866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912700 2023-02-11 00:55:27,565 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 1009e21fa89b40b9b2c69ed075368ca2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:27,565 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7d28c9011e8e4a6d866afbb51dc59a6b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:27,565 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7ca192618f8c4c129d7b09a2543abb28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:27,566 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 28b78e1a16854ffdb547038ec9ca5212, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:27,575 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 023ae0c28a4f9953fdcf7c55b19f9acd#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:27,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567] to archive 2023-02-11 00:55:27,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:27,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/4626a1d7b41b468a84359d1976dc4b73 2023-02-11 00:55:27,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/e802e0b003d448929a1a2419211b2d70 2023-02-11 00:55:27,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/63f40345712541698a8fb8b8027212cf 2023-02-11 00:55:27,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/f8a467f8c4f246558091682134bb26d1 2023-02-11 00:55:27,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/eef3050445264b508544b44cd3b50567 2023-02-11 00:55:27,984 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del 2023-02-11 00:55:27,984 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del 2023-02-11 00:55:28,797 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0650e3707aed4fe8b7d50a617e4a6388 2023-02-11 00:55:28,797 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/0650e3707aed4fe8b7d50a617e4a6388 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/0650e3707aed4fe8b7d50a617e4a6388 2023-02-11 00:55:28,801 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0650e3707aed4fe8b7d50a617e4a6388 2023-02-11 00:55:28,801 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 023ae0c28a4f9953fdcf7c55b19f9acd/family2 of 023ae0c28a4f9953fdcf7c55b19f9acd into 0650e3707aed4fe8b7d50a617e4a6388(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:28,802 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:28,802 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:28,802 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 is initiating major compaction (all files) 2023-02-11 00:55:28,802 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:28,802 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:28,802 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 in testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:28,802 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp, totalSize=26.7 K 2023-02-11 00:55:28,802 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting d6ae4ebf39b94193899e1b35e991e82d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912678 2023-02-11 00:55:28,803 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting ecae5951760a4fc3b122d460705fe026, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:28,803 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 72b7675bdfa847d3a18ad4805361cd7f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:28,803 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 8652069ddf80480f8c63f073a6856362, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:28,804 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 70954af4513f408c9ca083b5ad226ce8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:28,814 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): cc1065bd3f43e44e7e6d2a0b5c404d8f#family1#compaction#111 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:28,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212] to archive 2023-02-11 00:55:28,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:28,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/34758606a35744c9817c20d195ee8866 2023-02-11 00:55:28,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/1009e21fa89b40b9b2c69ed075368ca2 2023-02-11 00:55:28,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7d28c9011e8e4a6d866afbb51dc59a6b 2023-02-11 00:55:28,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/7ca192618f8c4c129d7b09a2543abb28 2023-02-11 00:55:28,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/28b78e1a16854ffdb547038ec9ca5212 2023-02-11 00:55:29,221 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del 2023-02-11 00:55:29,221 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del 2023-02-11 00:55:30,034 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f33e6018f6f44365ba4ccda42ff9612e 2023-02-11 00:55:30,035 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/f33e6018f6f44365ba4ccda42ff9612e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/f33e6018f6f44365ba4ccda42ff9612e 2023-02-11 00:55:30,038 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f33e6018f6f44365ba4ccda42ff9612e 2023-02-11 00:55:30,039 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 of cc1065bd3f43e44e7e6d2a0b5c404d8f into f33e6018f6f44365ba4ccda42ff9612e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:30,039 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:30,039 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:30,039 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 is initiating major compaction (all files) 2023-02-11 00:55:30,040 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:30,040 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:30,040 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 in testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:30,040 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp, totalSize=25.4 K 2023-02-11 00:55:30,041 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 21cb0c1a64494fa2b6f78a61cb3c73a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912678 2023-02-11 00:55:30,041 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 054fdb4bc4554831a1aaa6ae48df102b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:30,041 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 68d4c0df6f32497e9e06d60619a4ba97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:30,042 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting c89e59e7afa542968fcb3ab138c8aa29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:30,042 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 3838850ecc6f4b89af4a3d781fa0b91e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 00:55:30,053 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): cc1065bd3f43e44e7e6d2a0b5c404d8f#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:30,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8] to archive 2023-02-11 00:55:30,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:30,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/d6ae4ebf39b94193899e1b35e991e82d 2023-02-11 00:55:30,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/ecae5951760a4fc3b122d460705fe026 2023-02-11 00:55:30,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/72b7675bdfa847d3a18ad4805361cd7f 2023-02-11 00:55:30,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8652069ddf80480f8c63f073a6856362 2023-02-11 00:55:30,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/70954af4513f408c9ca083b5ad226ce8 2023-02-11 00:55:30,463 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del 2023-02-11 00:55:30,463 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del 2023-02-11 00:55:31,275 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5676570911604ac2969f026374b6e0a9 2023-02-11 00:55:31,276 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/5676570911604ac2969f026374b6e0a9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/5676570911604ac2969f026374b6e0a9 2023-02-11 00:55:31,279 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5676570911604ac2969f026374b6e0a9 2023-02-11 00:55:31,280 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 of cc1065bd3f43e44e7e6d2a0b5c404d8f into 5676570911604ac2969f026374b6e0a9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:31,280 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:31,285 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:31,288 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:31,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e] to archive 2023-02-11 00:55:31,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:31,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/21cb0c1a64494fa2b6f78a61cb3c73a4 2023-02-11 00:55:31,293 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:31,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/054fdb4bc4554831a1aaa6ae48df102b 2023-02-11 00:55:31,294 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:31,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/68d4c0df6f32497e9e06d60619a4ba97 2023-02-11 00:55:31,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/c89e59e7afa542968fcb3ab138c8aa29 2023-02-11 00:55:31,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/3838850ecc6f4b89af4a3d781fa0b91e 2023-02-11 00:55:31,300 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:55:31,330 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 00:55:31,333 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del 2023-02-11 00:55:31,336 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del 2023-02-11 00:55:31,338 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del 2023-02-11 00:55:31,338 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:31,338 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(139): Connect 0x662cdd77 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:31,343 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f1c251c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:31,343 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:31,343 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:31,344 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:31,400 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11 2023-02-11 00:55:31,401 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:31,417 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:31,421 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:31,426 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:31,428 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:31,435 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/b34184144d0e4326abd76155fa72b2f7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 00:55:31,436 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/b34184144d0e4326abd76155fa72b2f7}] 2023-02-11 00:55:31,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/b34184144d0e4326abd76155fa72b2f7 for inclusion in b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:31,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 00:55:31,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 00:55:31,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:31,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/b34184144d0e4326abd76155fa72b2f7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__gfnrq01osrad977o76ctlvtchhln69ca7gecu58qgadhusro6n3bqpfhi7s5c677/family1/b34184144d0e4326abd76155fa72b2f7 2023-02-11 00:55:31,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__gfnrq01osrad977o76ctlvtchhln69ca7gecu58qgadhusro6n3bqpfhi7s5c677/family1/b34184144d0e4326abd76155fa72b2f7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ 2023-02-11 00:55:31,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__gfnrq01osrad977o76ctlvtchhln69ca7gecu58qgadhusro6n3bqpfhi7s5c677/family1/b34184144d0e4326abd76155fa72b2f7 into b43278b0748bb249ee9de5ea2a2e7a01/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ - updating store file list. 2023-02-11 00:55:31,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ into b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:31,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__gfnrq01osrad977o76ctlvtchhln69ca7gecu58qgadhusro6n3bqpfhi7s5c677/family1/b34184144d0e4326abd76155fa72b2f7 into b43278b0748bb249ee9de5ea2a2e7a01/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_) 2023-02-11 00:55:31,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__gfnrq01osrad977o76ctlvtchhln69ca7gecu58qgadhusro6n3bqpfhi7s5c677/family1/b34184144d0e4326abd76155fa72b2f7 2023-02-11 00:55:31,450 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:31,451 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:31,452 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e 2023-02-11 00:55:31,453 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c 2023-02-11 00:55:31,453 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 2023-02-11 00:55:31,454 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 2023-02-11 00:55:31,454 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:31,454 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 00:55:31,455 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:31,798 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985 2023-02-11 00:55:31,798 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:31,829 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/04951d4f35984619b9a01588121f4049 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 00:55:31,831 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/04951d4f35984619b9a01588121f4049}] 2023-02-11 00:55:31,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/04951d4f35984619b9a01588121f4049 for inclusion in cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 00:55:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 00:55:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/04951d4f35984619b9a01588121f4049 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__93dn2d1um5ptgvkv3fls586842s47qpjnrlu34nmju225od9536ctec176mbo68a/family1/04951d4f35984619b9a01588121f4049 2023-02-11 00:55:31,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__93dn2d1um5ptgvkv3fls586842s47qpjnrlu34nmju225od9536ctec176mbo68a/family1/04951d4f35984619b9a01588121f4049 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ 2023-02-11 00:55:31,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__93dn2d1um5ptgvkv3fls586842s47qpjnrlu34nmju225od9536ctec176mbo68a/family1/04951d4f35984619b9a01588121f4049 into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ - updating store file list. 2023-02-11 00:55:31,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:31,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__93dn2d1um5ptgvkv3fls586842s47qpjnrlu34nmju225od9536ctec176mbo68a/family1/04951d4f35984619b9a01588121f4049 into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_) 2023-02-11 00:55:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__93dn2d1um5ptgvkv3fls586842s47qpjnrlu34nmju225od9536ctec176mbo68a/family1/04951d4f35984619b9a01588121f4049 2023-02-11 00:55:31,842 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:31,843 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:31,845 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a 2023-02-11 00:55:31,846 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 2023-02-11 00:55:31,847 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a 2023-02-11 00:55:31,848 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 2023-02-11 00:55:31,848 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:31,848 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 00:55:31,848 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:32,199 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2 2023-02-11 00:55:32,200 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:32,223 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ed7ce0737c7f405681c3ebbd97c06190 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 00:55:32,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ed7ce0737c7f405681c3ebbd97c06190}] 2023-02-11 00:55:32,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ed7ce0737c7f405681c3ebbd97c06190 for inclusion in 023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:32,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 00:55:32,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 00:55:32,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:32,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ed7ce0737c7f405681c3ebbd97c06190 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__1spfrf094cpkvkg30uq88rk1d4htte5ve9a3udme1rnfrt8htmavbt4tj2q1aumg/family1/ed7ce0737c7f405681c3ebbd97c06190 2023-02-11 00:55:32,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__1spfrf094cpkvkg30uq88rk1d4htte5ve9a3udme1rnfrt8htmavbt4tj2q1aumg/family1/ed7ce0737c7f405681c3ebbd97c06190 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ 2023-02-11 00:55:32,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__1spfrf094cpkvkg30uq88rk1d4htte5ve9a3udme1rnfrt8htmavbt4tj2q1aumg/family1/ed7ce0737c7f405681c3ebbd97c06190 into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ - updating store file list. 2023-02-11 00:55:32,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:32,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__1spfrf094cpkvkg30uq88rk1d4htte5ve9a3udme1rnfrt8htmavbt4tj2q1aumg/family1/ed7ce0737c7f405681c3ebbd97c06190 into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_) 2023-02-11 00:55:32,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__1spfrf094cpkvkg30uq88rk1d4htte5ve9a3udme1rnfrt8htmavbt4tj2q1aumg/family1/ed7ce0737c7f405681c3ebbd97c06190 2023-02-11 00:55:32,237 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:32,238 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:32,239 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 2023-02-11 00:55:32,240 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c 2023-02-11 00:55:32,241 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 2023-02-11 00:55:32,242 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 2023-02-11 00:55:32,242 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:32,242 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 00:55:32,242 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:32,242 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:32,242 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:32,242 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del] 2023-02-11 00:55:32,243 DEBUG [Listener at localhost/36341] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:32,244 DEBUG [Listener at localhost/36341] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211d8ce678224944e2facfe74d2db9dd164_del 2023-02-11 00:55:32,244 INFO [Listener at localhost/36341] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 00:55:32,244 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del] 2023-02-11 00:55:32,244 DEBUG [Listener at localhost/36341] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:32,245 DEBUG [Listener at localhost/36341] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021152661f07c27c4d82a37c6b062c00e67e_del 2023-02-11 00:55:32,245 INFO [Listener at localhost/36341] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 00:55:32,246 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del] 2023-02-11 00:55:32,246 DEBUG [Listener at localhost/36341] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:32,247 DEBUG [Listener at localhost/36341] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211437e9798c518472fa760c5713de9d4fd_del 2023-02-11 00:55:32,247 INFO [Listener at localhost/36341] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 00:55:32,249 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:32,251 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:32,254 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:32,255 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:32,261 INFO [Listener at localhost/36341] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-11 00:55:32,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-11 00:55:32,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-11 00:55:32,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 00:55:32,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076932264"}]},"ts":"1676076932264"} 2023-02-11 00:55:32,266 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-11 00:55:32,267 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-11 00:55:32,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, UNASSIGN}] 2023-02-11 00:55:32,269 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, UNASSIGN 2023-02-11 00:55:32,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, UNASSIGN 2023-02-11 00:55:32,269 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, UNASSIGN 2023-02-11 00:55:32,270 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:32,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:32,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:32,270 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076932270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076932270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076932270"}]},"ts":"1676076932270"} 2023-02-11 00:55:32,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076932270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076932270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076932270"}]},"ts":"1676076932270"} 2023-02-11 00:55:32,270 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076932270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076932270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076932270"}]},"ts":"1676076932270"} 2023-02-11 00:55:32,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:32,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:32,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:32,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 00:55:32,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:32,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b43278b0748bb249ee9de5ea2a2e7a01, disabling compactions & flushes 2023-02-11 00:55:32,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:32,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:32,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. after waiting 0 ms 2023-02-11 00:55:32,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:32,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 00:55:32,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:32,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b43278b0748bb249ee9de5ea2a2e7a01: Waiting for close lock at 1676076932422Running coprocessor pre-close hooks at 1676076932422Disabling compacts and flushes for region at 1676076932422Disabling writes for close at 1676076932423 (+1 ms)Writing region close event to WAL at 1676076932424 (+1 ms)Running coprocessor post-close hooks at 1676076932427 (+3 ms)Closed at 1676076932427 2023-02-11 00:55:32,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:32,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:32,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 023ae0c28a4f9953fdcf7c55b19f9acd, disabling compactions & flushes 2023-02-11 00:55:32,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:32,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:32,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. after waiting 0 ms 2023-02-11 00:55:32,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:32,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=CLOSED 2023-02-11 00:55:32,429 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076932429"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076932429"}]},"ts":"1676076932429"} 2023-02-11 00:55:32,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-11 00:55:32,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915 in 159 msec 2023-02-11 00:55:32,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 00:55:32,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, UNASSIGN in 164 msec 2023-02-11 00:55:32,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:32,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 023ae0c28a4f9953fdcf7c55b19f9acd: Waiting for close lock at 1676076932429Running coprocessor pre-close hooks at 1676076932429Disabling compacts and flushes for region at 1676076932429Disabling writes for close at 1676076932429Writing region close event to WAL at 1676076932430 (+1 ms)Running coprocessor post-close hooks at 1676076932433 (+3 ms)Closed at 1676076932434 (+1 ms) 2023-02-11 00:55:32,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:32,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cc1065bd3f43e44e7e6d2a0b5c404d8f, disabling compactions & flushes 2023-02-11 00:55:32,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. after waiting 0 ms 2023-02-11 00:55:32,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:32,435 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=CLOSED 2023-02-11 00:55:32,435 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076932435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076932435"}]},"ts":"1676076932435"} 2023-02-11 00:55:32,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-11 00:55:32,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915 in 164 msec 2023-02-11 00:55:32,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, UNASSIGN in 169 msec 2023-02-11 00:55:32,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 00:55:32,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:32,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: Waiting for close lock at 1676076932435Running coprocessor pre-close hooks at 1676076932435Disabling compacts and flushes for region at 1676076932435Disabling writes for close at 1676076932435Writing region close event to WAL at 1676076932436 (+1 ms)Running coprocessor post-close hooks at 1676076932439 (+3 ms)Closed at 1676076932439 2023-02-11 00:55:32,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:32,441 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=CLOSED 2023-02-11 00:55:32,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076932440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076932440"}]},"ts":"1676076932440"} 2023-02-11 00:55:32,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-11 00:55:32,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 171 msec 2023-02-11 00:55:32,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-11 00:55:32,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, UNASSIGN in 175 msec 2023-02-11 00:55:32,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076932444"}]},"ts":"1676076932444"} 2023-02-11 00:55:32,445 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-11 00:55:32,447 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-11 00:55:32,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 186 msec 2023-02-11 00:55:32,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 00:55:32,567 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-11 00:55:32,576 INFO [Listener at localhost/36341] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:32,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676076932577 (current time:1676076932577). 2023-02-11 00:55:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 00:55:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] zookeeper.ReadOnlyZKClient(139): Connect 0x12175770 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:32,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5bd3c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:32,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:32,586 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:32,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12175770 to 127.0.0.1:63942 2023-02-11 00:55:32,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:32,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 00:55:32,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:32,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:32,589 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:32,590 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676077532590 2023-02-11 00:55:32,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:32,590 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676076919877-1676076932576 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 00:55:32,590 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:32,590 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 00:55:32,690 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:32,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:32,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:32,692 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 00:55:32,892 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:32,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:32,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:32,893 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 00:55:32,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 00:55:32,997 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/f33e6018f6f44365ba4ccda42ff9612e] hfiles 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/f33e6018f6f44365ba4ccda42ff9612e 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/fb764f46d1d04470a46e62440e99726f] hfiles 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/e4e46da75e1e47079d898c675ea20c66] hfiles 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/fb764f46d1d04470a46e62440e99726f 2023-02-11 00:55:33,000 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/e4e46da75e1e47079d898c675ea20c66 2023-02-11 00:55:33,001 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11] hfiles 2023-02-11 00:55:33,001 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985 2023-02-11 00:55:33,001 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2 2023-02-11 00:55:33,001 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/5676570911604ac2969f026374b6e0a9] hfiles 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0a084f0449c84da8859b01e5ea58791f] hfiles 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/5676570911604ac2969f026374b6e0a9 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/0650e3707aed4fe8b7d50a617e4a6388] hfiles 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0a084f0449c84da8859b01e5ea58791f 2023-02-11 00:55:33,004 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/0650e3707aed4fe8b7d50a617e4a6388 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2] hfiles 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302110bef74a0de7b4740b3612fd2561caf6c 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112bc321f7c3654fe3944e5a4527877e8b 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302113a1f4cb531a84ccc8d24722641289f5c 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211e1c6ecd0d22d4df083cc07fa626af869 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211014a6624f1944e059f501873570c0f3e 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115dbb2f1962aa45b7a4f82db68bce1fc5 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211798cfaa1e0b2411383726a9ac5ba6863 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230211a7e6bda5f0e6435698611686279d5526 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211a31e46998aaa42799d6e2b3c2fc10e2c 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211b663e5c830f24f2ba2c80264c59b1a50 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211c316dba112ee43c4be7b6d23a601f6e8 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del 2023-02-11 00:55:33,010 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211e54c247bf42c44409ffaed491ed504f2 2023-02-11 00:55:33,193 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:33,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:33,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:33,194 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 00:55:33,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-11 00:55:33,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:33,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:33,694 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:33,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:33,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 00:55:33,695 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 00:55:33,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676076919877-1676076932576 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:34,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676076919877-1676076932576 of table testCompactionWithHFileLink completed 2023-02-11 00:55:34,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:34,660 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:34,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676076919877-1676076932576 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676076932590Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676076932996 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676076919877-1676076932576 at 1676076933424 (+428 ms)Loading Region manifests for hbase-failsafe-snaptb-1676076919877-1676076932576 at 1676076933424Writing data manifest for hbase-failsafe-snaptb-1676076919877-1676076932576 at 1676076933427 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1676076919877-1676076932576 at 1676076933833 (+406 ms)Snapshot hbase-failsafe-snaptb-1676076919877-1676076932576 of table testCompactionWithHFileLink completed at 1676076934659 (+826 ms) 2023-02-11 00:55:34,661 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 00:55:34,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0730 sec 2023-02-11 00:55:34,695 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 00:55:34,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 00:55:34,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676076919877-1676076932576 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 00:55:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676076919877" table: "testCompactionWithHFileLink" creation_time: 1676076919886 type: FLUSH version: 2 ttl: 0 ) 2023-02-11 00:55:34,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676076919877 as table=testCompactionWithHFileLink 2023-02-11 00:55:34,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 00:55:34,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 00:55:35,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 00:55:35,142 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 00:55:35,143 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:35,143 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 00:55:35,144 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 00:55:35,148 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676076919877" table: "testCompactionWithHFileLink" creation_time: 1676076919886 type: FLUSH version: 2 ttl: 0 2023-02-11 00:55:35,149 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink 2023-02-11 00:55:35,154 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-11 00:55:35,157 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211bdee316fc44d4d13a36c5b14655a4985 2023-02-11 00:55:35,159 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021172eeb3e88f6746e6b60373627b7272a2 2023-02-11 00:55:35,160 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302116e7afb28d29043108a590de112c36c11 2023-02-11 00:55:35,160 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,164 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,167 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,170 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,174 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,177 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,181 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,184 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,187 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,191 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,197 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,201 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 of snapshot=snaptb-1676076919877 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 00:55:35,208 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cde1124656064c6d8c6dd226626297c4_del 2023-02-11 00:55:35,209 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021192c81766896e45e7a33cff2a96221160_del 2023-02-11 00:55:35,210 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f87f00cc104149a88eb4a41ee6a51725_del 2023-02-11 00:55:35,210 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,210 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,210 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,214 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/e4e46da75e1e47079d898c675ea20c66 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/e4e46da75e1e47079d898c675ea20c66 2023-02-11 00:55:35,214 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/fb764f46d1d04470a46e62440e99726f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/fb764f46d1d04470a46e62440e99726f 2023-02-11 00:55:35,214 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/8797b4ed573d48158df92f4514b02f4a_SeqId_29_ 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/2a3d1dbe3f194232a9f0f4652afacc76_SeqId_29_ 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/f33e6018f6f44365ba4ccda42ff9612e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/f33e6018f6f44365ba4ccda42ff9612e 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/2b6baf6aebd8431cadb89c6a105b6be7_SeqId_29_ 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4626a1d7b41b468a84359d1976dc4b73 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a030230415a74159860fa283bc3c028a of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,215 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d6ae4ebf39b94193899e1b35e991e82d of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,224 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e802e0b003d448929a1a2419211b2d70 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,228 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ecae5951760a4fc3b122d460705fe026 of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,228 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fadc1cb32e91426e8c30a0e692753945 of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,230 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 63f40345712541698a8fb8b8027212cf of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,232 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 72b7675bdfa847d3a18ad4805361cd7f of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,233 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a1c47e823423480d85e744c0acb7e14b of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,241 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f8a467f8c4f246558091682134bb26d1 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,244 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8652069ddf80480f8c63f073a6856362 of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,244 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 49f23577e1464a5bbe2990b8a6b4ab81 of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,253 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/0650e3707aed4fe8b7d50a617e4a6388 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/0650e3707aed4fe8b7d50a617e4a6388 2023-02-11 00:55:35,253 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 34758606a35744c9817c20d195ee8866 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,254 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0a084f0449c84da8859b01e5ea58791f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/0a084f0449c84da8859b01e5ea58791f 2023-02-11 00:55:35,255 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/5676570911604ac2969f026374b6e0a9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/5676570911604ac2969f026374b6e0a9 2023-02-11 00:55:35,255 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 21cb0c1a64494fa2b6f78a61cb3c73a4 of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,255 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7b6e3545312d4eca94b9645ba9054834 of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,257 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1009e21fa89b40b9b2c69ed075368ca2 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,259 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 054fdb4bc4554831a1aaa6ae48df102b of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,259 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 39edbd4aaa8e41189f90c5c00830912f of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,260 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7d28c9011e8e4a6d866afbb51dc59a6b of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,262 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 68d4c0df6f32497e9e06d60619a4ba97 of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,262 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0f00443bccd446a5b46914a4ef290a1d of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,264 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7ca192618f8c4c129d7b09a2543abb28 of snapshot=snaptb-1676076919877 to region=023ae0c28a4f9953fdcf7c55b19f9acd table=testCompactionWithHFileLink 2023-02-11 00:55:35,265 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c89e59e7afa542968fcb3ab138c8aa29 of snapshot=snaptb-1676076919877 to region=cc1065bd3f43e44e7e6d2a0b5c404d8f table=testCompactionWithHFileLink 2023-02-11 00:55:35,266 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3d6da15792b440cea8f524c14dec2359 of snapshot=snaptb-1676076919877 to region=b43278b0748bb249ee9de5ea2a2e7a01 table=testCompactionWithHFileLink 2023-02-11 00:55:35,270 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676076919877" table: "testCompactionWithHFileLink" creation_time: 1676076919886 type: FLUSH version: 2 ttl: 0 2023-02-11 00:55:35,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676076935271"}]},"ts":"9223372036854775807"} 2023-02-11 00:55:35,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676076935271"}]},"ts":"9223372036854775807"} 2023-02-11 00:55:35,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676076935271"}]},"ts":"9223372036854775807"} 2023-02-11 00:55:35,273 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-11 00:55:35,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 023ae0c28a4f9953fdcf7c55b19f9acd, NAME => 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b43278b0748bb249ee9de5ea2a2e7a01, NAME => 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc1065bd3f43e44e7e6d2a0b5c404d8f, NAME => 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-11 00:55:35,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076935272"}]},"ts":"1676076935272"} 2023-02-11 00:55:35,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076935272"}]},"ts":"1676076935272"} 2023-02-11 00:55:35,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076935272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076935272"}]},"ts":"1676076935272"} 2023-02-11 00:55:35,275 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 00:55:35,275 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-11 00:55:35,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 023ae0c28a4f9953fdcf7c55b19f9acd, NAME => 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => b43278b0748bb249ee9de5ea2a2e7a01, NAME => 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc1065bd3f43e44e7e6d2a0b5c404d8f, NAME => 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-11 00:55:35,276 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676076919877 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-11 00:55:35,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676076919877" table: "testCompactionWithHFileLink" creation_time: 1676076919886 type: FLUSH version: 2 ttl: 0 ) in 553 msec 2023-02-11 00:55:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 00:55:35,337 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-11 00:55:35,337 INFO [Listener at localhost/36341] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:35,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676076919877-1676076932576" 2023-02-11 00:55:35,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676076919877-1676076932576 2023-02-11 00:55:35,346 INFO [Listener at localhost/36341] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-11 00:55:35,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-11 00:55:35,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-11 00:55:35,360 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-11 00:55:35,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076935360"}]},"ts":"1676076935360"} 2023-02-11 00:55:35,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 00:55:35,361 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 00:55:35,364 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-11 00:55:35,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN}] 2023-02-11 00:55:35,365 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN 2023-02-11 00:55:35,366 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN 2023-02-11 00:55:35,366 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN 2023-02-11 00:55:35,366 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 00:55:35,366 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 00:55:35,366 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 00:55:35,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 00:55:35,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,518 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076935518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076935518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076935518"}]},"ts":"1676076935518"} 2023-02-11 00:55:35,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076935518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076935518"}]},"ts":"1676076935518"} 2023-02-11 00:55:35,518 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076935518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076935518"}]},"ts":"1676076935518"} 2023-02-11 00:55:35,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:35,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:35,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:35,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 00:55:35,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 023ae0c28a4f9953fdcf7c55b19f9acd, NAME => 'testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 00:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,676 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,677 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:35,677 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:35,677 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 023ae0c28a4f9953fdcf7c55b19f9acd columnFamilyName family1 2023-02-11 00:55:35,695 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73 2023-02-11 00:55:35,701 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf 2023-02-11 00:55:35,707 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70 2023-02-11 00:55:35,712 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1 2023-02-11 00:55:35,712 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(310): Store=023ae0c28a4f9953fdcf7c55b19f9acd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,712 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,713 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2 2023-02-11 00:55:35,713 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2 2023-02-11 00:55:35,713 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 023ae0c28a4f9953fdcf7c55b19f9acd columnFamilyName family2 2023-02-11 00:55:35,726 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2 2023-02-11 00:55:35,732 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866 2023-02-11 00:55:35,738 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28 2023-02-11 00:55:35,743 DEBUG [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b 2023-02-11 00:55:35,743 INFO [StoreOpener-023ae0c28a4f9953fdcf7c55b19f9acd-1] regionserver.HStore(310): Store=023ae0c28a4f9953fdcf7c55b19f9acd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:35,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:55:35,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 023ae0c28a4f9953fdcf7c55b19f9acd; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70993689, jitterRate=0.05788840353488922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:35,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 023ae0c28a4f9953fdcf7c55b19f9acd: Running coprocessor pre-open hook at 1676076935674Writing region info on filesystem at 1676076935674Initializing all the Stores at 1676076935675 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935675Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935676 (+1 ms)Cleaning up temporary data from old regions at 1676076935745 (+69 ms)Cleaning up detritus from prior splits at 1676076935746 (+1 ms)Running coprocessor post-open hooks at 1676076935748 (+2 ms)Region opened successfully at 1676076935748 2023-02-11 00:55:35,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., pid=102, masterSystemTime=1676076935671 2023-02-11 00:55:35,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:35,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 00:55:35,749 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 00:55:35,749 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 00:55:35,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:35,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:35,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b43278b0748bb249ee9de5ea2a2e7a01, NAME => 'testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 00:55:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=023ae0c28a4f9953fdcf7c55b19f9acd, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076935751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076935751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076935751"}]},"ts":"1676076935751"} 2023-02-11 00:55:35,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,751 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 00:55:35,752 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 00:55:35,752 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1912): 023ae0c28a4f9953fdcf7c55b19f9acd/family1 is initiating minor compaction (all files) 2023-02-11 00:55:35,752 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1912): 023ae0c28a4f9953fdcf7c55b19f9acd/family2 is initiating minor compaction (all files) 2023-02-11 00:55:35,752 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 023ae0c28a4f9953fdcf7c55b19f9acd/family1 in testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:35,752 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 023ae0c28a4f9953fdcf7c55b19f9acd/family2 in testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:55:35,752 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp, totalSize=21.6 K 2023-02-11 00:55:35,752 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp, totalSize=20.4 K 2023-02-11 00:55:35,752 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,753 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912700 2023-02-11 00:55:35,753 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912700 2023-02-11 00:55:35,754 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:35,754 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:35,754 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:35,754 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:35,754 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43278b0748bb249ee9de5ea2a2e7a01 columnFamilyName family1 2023-02-11 00:55:35,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-11 00:55:35,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 023ae0c28a4f9953fdcf7c55b19f9acd, server=jenkins-hbase4.apache.org,43697,1676076813915 in 232 msec 2023-02-11 00:55:35,755 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:35,755 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:35,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=023ae0c28a4f9953fdcf7c55b19f9acd, ASSIGN in 390 msec 2023-02-11 00:55:35,756 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:35,757 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:35,768 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81 2023-02-11 00:55:35,778 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a 2023-02-11 00:55:35,792 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b 2023-02-11 00:55:35,797 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): 023ae0c28a4f9953fdcf7c55b19f9acd#family1#compaction#113 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:35,808 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] throttle.PressureAwareThroughputController(145): 023ae0c28a4f9953fdcf7c55b19f9acd#family2#compaction#114 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:35,811 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945 2023-02-11 00:55:35,811 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(310): Store=b43278b0748bb249ee9de5ea2a2e7a01/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,812 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,815 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2 2023-02-11 00:55:35,815 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2 2023-02-11 00:55:35,816 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43278b0748bb249ee9de5ea2a2e7a01 columnFamilyName family2 2023-02-11 00:55:35,824 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d 2023-02-11 00:55:35,829 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f 2023-02-11 00:55:35,842 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359 2023-02-11 00:55:35,847 DEBUG [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834 2023-02-11 00:55:35,847 INFO [StoreOpener-b43278b0748bb249ee9de5ea2a2e7a01-1] regionserver.HStore(310): Store=b43278b0748bb249ee9de5ea2a2e7a01/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:35,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:55:35,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b43278b0748bb249ee9de5ea2a2e7a01; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70477361, jitterRate=0.05019451677799225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:35,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b43278b0748bb249ee9de5ea2a2e7a01: Running coprocessor pre-open hook at 1676076935751Writing region info on filesystem at 1676076935751Initializing all the Stores at 1676076935752 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935752Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935752Cleaning up temporary data from old regions at 1676076935850 (+98 ms)Cleaning up detritus from prior splits at 1676076935850Running coprocessor post-open hooks at 1676076935853 (+3 ms)Region opened successfully at 1676076935853 2023-02-11 00:55:35,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., pid=103, masterSystemTime=1676076935671 2023-02-11 00:55:35,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 00:55:35,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 00:55:35,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:35,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:35,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:35,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cc1065bd3f43e44e7e6d2a0b5c404d8f, NAME => 'testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 00:55:35,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=b43278b0748bb249ee9de5ea2a2e7a01, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:35,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676076935855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076935855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076935855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076935855"}]},"ts":"1676076935855"} 2023-02-11 00:55:35,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,857 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,857 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:35,857 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:35,858 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1065bd3f43e44e7e6d2a0b5c404d8f columnFamilyName family1 2023-02-11 00:55:35,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-11 00:55:35,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure b43278b0748bb249ee9de5ea2a2e7a01, server=jenkins-hbase4.apache.org,43697,1676076813915 in 339 msec 2023-02-11 00:55:35,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b43278b0748bb249ee9de5ea2a2e7a01, ASSIGN in 497 msec 2023-02-11 00:55:35,866 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-02-11 00:55:35,867 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f 2023-02-11 00:55:35,873 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362 2023-02-11 00:55:35,880 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d 2023-02-11 00:55:35,887 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026 2023-02-11 00:55:35,887 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(310): Store=cc1065bd3f43e44e7e6d2a0b5c404d8f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,888 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,889 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 2023-02-11 00:55:35,889 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 2023-02-11 00:55:35,889 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1065bd3f43e44e7e6d2a0b5c404d8f columnFamilyName family2 2023-02-11 00:55:35,899 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b 2023-02-11 00:55:35,908 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4 2023-02-11 00:55:35,920 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97 2023-02-11 00:55:35,926 DEBUG [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(539): loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29 2023-02-11 00:55:35,926 INFO [StoreOpener-cc1065bd3f43e44e7e6d2a0b5c404d8f-1] regionserver.HStore(310): Store=cc1065bd3f43e44e7e6d2a0b5c404d8f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:35,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:55:35,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cc1065bd3f43e44e7e6d2a0b5c404d8f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65355880, jitterRate=-0.02612149715423584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:35,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: Running coprocessor pre-open hook at 1676076935856Writing region info on filesystem at 1676076935856Initializing all the Stores at 1676076935856Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935856Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076935856Cleaning up temporary data from old regions at 1676076935929 (+73 ms)Cleaning up detritus from prior splits at 1676076935929Running coprocessor post-open hooks at 1676076935931 (+2 ms)Region opened successfully at 1676076935931 2023-02-11 00:55:35,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., pid=101, masterSystemTime=1676076935671 2023-02-11 00:55:35,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-11 00:55:35,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 00:55:35,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:35,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:35,934 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=cc1065bd3f43e44e7e6d2a0b5c404d8f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:35,934 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076935933"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076935933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076935933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076935933"}]},"ts":"1676076935933"} 2023-02-11 00:55:35,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-11 00:55:35,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure cc1065bd3f43e44e7e6d2a0b5c404d8f, server=jenkins-hbase4.apache.org,43697,1676076813915 in 416 msec 2023-02-11 00:55:35,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-11 00:55:35,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cc1065bd3f43e44e7e6d2a0b5c404d8f, ASSIGN in 572 msec 2023-02-11 00:55:35,938 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076935938"}]},"ts":"1676076935938"} 2023-02-11 00:55:35,939 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 00:55:35,941 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-11 00:55:35,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 588 msec 2023-02-11 00:55:35,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 00:55:35,964 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-11 00:55:35,975 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:35,984 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:35,991 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:35,992 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:35,997 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:55:36,010 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 00:55:36,010 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,010 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(139): Connect 0x4537b106 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:36,014 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@690d99f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:36,014 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,014 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,014 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,488 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211039fe5ef8bdd4d9e901016c36e0c10be to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211039fe5ef8bdd4d9e901016c36e0c10be 2023-02-11 00:55:36,488 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,501 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:36,504 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:36,510 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:36,512 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:36,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/f11c275904ce484f921360f32ce6f441 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-11 00:55:36,523 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/f11c275904ce484f921360f32ce6f441}] 2023-02-11 00:55:36,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/f11c275904ce484f921360f32ce6f441 for inclusion in cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:36,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-11 00:55:36,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 00:55:36,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:36,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/f11c275904ce484f921360f32ce6f441 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__qttse1f7taou1jpi0lp00od74fnhfvtdp0cgq2jcsncrccvukq8jamt7cci64ch2/family1/f11c275904ce484f921360f32ce6f441 2023-02-11 00:55:36,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__qttse1f7taou1jpi0lp00od74fnhfvtdp0cgq2jcsncrccvukq8jamt7cci64ch2/family1/f11c275904ce484f921360f32ce6f441 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_ 2023-02-11 00:55:36,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__qttse1f7taou1jpi0lp00od74fnhfvtdp0cgq2jcsncrccvukq8jamt7cci64ch2/family1/f11c275904ce484f921360f32ce6f441 into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_ - updating store file list. 2023-02-11 00:55:36,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_ into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 2023-02-11 00:55:36,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__qttse1f7taou1jpi0lp00od74fnhfvtdp0cgq2jcsncrccvukq8jamt7cci64ch2/family1/f11c275904ce484f921360f32ce6f441 into cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_) 2023-02-11 00:55:36,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__qttse1f7taou1jpi0lp00od74fnhfvtdp0cgq2jcsncrccvukq8jamt7cci64ch2/family1/f11c275904ce484f921360f32ce6f441 2023-02-11 00:55:36,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:36,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 00:55:36,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 is initiating minor compaction (all files) 2023-02-11 00:55:36,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2a2efa37; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 00:55:36,541 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,542 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:36,544 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211381c45bbcf074bfca146cfc93ff4029a 2023-02-11 00:55:36,545 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302117d19114f7e0d420296511c13b54a1011 2023-02-11 00:55:36,546 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211aa49a629032441c8b511df6c6cdfe10a 2023-02-11 00:55:36,547 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211fbfcf4bdfd31449d8eab7fce6e10aa97 2023-02-11 00:55:36,547 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:36,547 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 00:55:36,547 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,631 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family1/97b3f1a8c19948c6b749980b81575f25 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/97b3f1a8c19948c6b749980b81575f25 2023-02-11 00:55:36,635 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 023ae0c28a4f9953fdcf7c55b19f9acd/family1 of 023ae0c28a4f9953fdcf7c55b19f9acd into 97b3f1a8c19948c6b749980b81575f25(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:55:36,635 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:36,635 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., storeName=023ae0c28a4f9953fdcf7c55b19f9acd/family1, priority=12, startTime=1676076935748; duration=0sec 2023-02-11 00:55:36,635 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 00:55:36,635 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 in testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:36,635 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp, totalSize=28.9 K 2023-02-11 00:55:36,636 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912678 2023-02-11 00:55:36,636 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:36,637 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:36,637 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:36,637 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676076912678 2023-02-11 00:55:36,649 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): cc1065bd3f43e44e7e6d2a0b5c404d8f#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:36,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1] to archive 2023-02-11 00:55:36,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:36,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-4626a1d7b41b468a84359d1976dc4b73 2023-02-11 00:55:36,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-e802e0b003d448929a1a2419211b2d70 2023-02-11 00:55:36,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-63f40345712541698a8fb8b8027212cf 2023-02-11 00:55:36,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-f8a467f8c4f246558091682134bb26d1 2023-02-11 00:55:36,888 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211b111c738f7f54803a2c844cf636a9daf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211b111c738f7f54803a2c844cf636a9daf 2023-02-11 00:55:36,888 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ef1883e3e2ec43d7923f799ef9e82b84 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ef1883e3e2ec43d7923f799ef9e82b84 2023-02-11 00:55:36,889 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,889 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/bdf7d62d204142aab229bfcf8b0d2ff6 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-11 00:55:36,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/165b19a14427474f9a0aa312279422fc first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-11 00:55:36,917 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/bdf7d62d204142aab229bfcf8b0d2ff6}] 2023-02-11 00:55:36,917 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=32 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/165b19a14427474f9a0aa312279422fc}] 2023-02-11 00:55:36,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/bdf7d62d204142aab229bfcf8b0d2ff6 for inclusion in 023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:36,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/165b19a14427474f9a0aa312279422fc for inclusion in b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:36,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-11 00:55:36,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-11 00:55:36,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 00:55:36,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 00:55:36,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:36,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:36,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/165b19a14427474f9a0aa312279422fc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__iev9hi2g01eugn4vrbp25kfie1p7bo4to7q8qsvnunv4ikusnqq13hga1ppn7ut1/family1/165b19a14427474f9a0aa312279422fc 2023-02-11 00:55:36,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/bdf7d62d204142aab229bfcf8b0d2ff6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__tduo4pkmnnah743jktk23jnu7ocb6i1dj49i8unsa7t7mmclthm7db4bj930q7jf/family1/bdf7d62d204142aab229bfcf8b0d2ff6 2023-02-11 00:55:36,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__iev9hi2g01eugn4vrbp25kfie1p7bo4to7q8qsvnunv4ikusnqq13hga1ppn7ut1/family1/165b19a14427474f9a0aa312279422fc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_ 2023-02-11 00:55:36,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__tduo4pkmnnah743jktk23jnu7ocb6i1dj49i8unsa7t7mmclthm7db4bj930q7jf/family1/bdf7d62d204142aab229bfcf8b0d2ff6 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/65878ab9ee84474ca806f2c28a7c18b4_SeqId_35_ 2023-02-11 00:55:36,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__iev9hi2g01eugn4vrbp25kfie1p7bo4to7q8qsvnunv4ikusnqq13hga1ppn7ut1/family1/165b19a14427474f9a0aa312279422fc into b43278b0748bb249ee9de5ea2a2e7a01/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_ - updating store file list. 2023-02-11 00:55:36,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__tduo4pkmnnah743jktk23jnu7ocb6i1dj49i8unsa7t7mmclthm7db4bj930q7jf/family1/bdf7d62d204142aab229bfcf8b0d2ff6 into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/65878ab9ee84474ca806f2c28a7c18b4_SeqId_35_ - updating store file list. 2023-02-11 00:55:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_ into b43278b0748bb249ee9de5ea2a2e7a01/family1 2023-02-11 00:55:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__iev9hi2g01eugn4vrbp25kfie1p7bo4to7q8qsvnunv4ikusnqq13hga1ppn7ut1/family1/165b19a14427474f9a0aa312279422fc into b43278b0748bb249ee9de5ea2a2e7a01/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_) 2023-02-11 00:55:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/65878ab9ee84474ca806f2c28a7c18b4_SeqId_35_ into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 2023-02-11 00:55:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__tduo4pkmnnah743jktk23jnu7ocb6i1dj49i8unsa7t7mmclthm7db4bj930q7jf/family1/bdf7d62d204142aab229bfcf8b0d2ff6 into 023ae0c28a4f9953fdcf7c55b19f9acd/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family1/65878ab9ee84474ca806f2c28a7c18b4_SeqId_35_) 2023-02-11 00:55:36,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__iev9hi2g01eugn4vrbp25kfie1p7bo4to7q8qsvnunv4ikusnqq13hga1ppn7ut1/family1/165b19a14427474f9a0aa312279422fc 2023-02-11 00:55:36,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testCompactionWithHFileLink__tduo4pkmnnah743jktk23jnu7ocb6i1dj49i8unsa7t7mmclthm7db4bj930q7jf/family1/bdf7d62d204142aab229bfcf8b0d2ff6 2023-02-11 00:55:36,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:36,931 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,931 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:36,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 00:55:36,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): b43278b0748bb249ee9de5ea2a2e7a01/family1 is initiating minor compaction (all files) 2023-02-11 00:55:36,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d7deaf3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 00:55:36,933 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302113a710b9f66df4f1e94e13eb207feba76 2023-02-11 00:55:36,933 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,933 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211adfba1f51cf849a1809a22f070d57c7c 2023-02-11 00:55:36,934 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:36,934 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211c42c303a563e470db17378472e084784 2023-02-11 00:55:36,935 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302113432414d82cb4d55b17599395d835d8e 2023-02-11 00:55:36,936 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211d60afffb04a84ba79e414bc4110778e0 2023-02-11 00:55:36,936 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:36,936 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 00:55:36,936 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,936 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211a25018d0c7c94e8abbd4f051e6a0756c 2023-02-11 00:55:36,937 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211b08a54b7f92b41afa0b278fa837ca863 2023-02-11 00:55:36,938 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211c7526ee617b8496b89614b92517f62f8 2023-02-11 00:55:36,938 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 00:55:36,938 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 00:55:36,938 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 00:55:36,938 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 00:55:36,940 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:36,942 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:36,946 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:36,947 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:36,952 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:36,953 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:36,968 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 253) - Thread LEAK? -, OpenFileDescriptor=760 (was 639) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=113 (was 149), ProcessCount=168 (was 168), AvailableMemoryMB=2969 (was 3099) 2023-02-11 00:55:36,980 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=760, MaxFileDescriptor=60000, SystemLoadAverage=113, ProcessCount=168, AvailableMemoryMB=2968 2023-02-11 00:55:36,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-11 00:55:36,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-11 00:55:36,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 00:55:36,991 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 00:55:36,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-11 00:55:37,036 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/.tmp/family2/08676940058648e59d728817e39a50dc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/08676940058648e59d728817e39a50dc 2023-02-11 00:55:37,040 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 023ae0c28a4f9953fdcf7c55b19f9acd/family2 of 023ae0c28a4f9953fdcf7c55b19f9acd into 08676940058648e59d728817e39a50dc(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:37,041 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 023ae0c28a4f9953fdcf7c55b19f9acd: 2023-02-11 00:55:37,041 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd., storeName=023ae0c28a4f9953fdcf7c55b19f9acd/family2, priority=12, startTime=1676076935749; duration=1sec 2023-02-11 00:55:37,041 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 00:55:37,041 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2258): Starting compaction of b43278b0748bb249ee9de5ea2a2e7a01/family1 in testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:37,041 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp, totalSize=28.9 K 2023-02-11 00:55:37,042 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912677 2023-02-11 00:55:37,042 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914491 2023-02-11 00:55:37,043 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916292 2023-02-11 00:55:37,044 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:37,044 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting 65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676076912677 2023-02-11 00:55:37,062 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] throttle.PressureAwareThroughputController(145): b43278b0748bb249ee9de5ea2a2e7a01#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:37,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 00:55:37,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28] to archive 2023-02-11 00:55:37,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:37,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 00:55:37,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-11 00:55:37,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-34758606a35744c9817c20d195ee8866 2023-02-11 00:55:37,094 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:55:37,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-11 00:55:37,094 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:55:37,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-1009e21fa89b40b9b2c69ed075368ca2 2023-02-11 00:55:37,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:37,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7d28c9011e8e4a6d866afbb51dc59a6b 2023-02-11 00:55:37,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:37,096 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:37,096 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381 empty. 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c empty. 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74 empty. 2023-02-11 00:55:37,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/family2/testCompactionWithHFileLink=023ae0c28a4f9953fdcf7c55b19f9acd-7ca192618f8c4c129d7b09a2543abb28 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:37,097 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:37,097 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-11 00:55:37,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:37,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:37,504 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:37,505 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 897ed1e72710a942b6f8cdb46e38cc74, NAME => 'ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:37,505 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 80edaca03d31c7d428645cb0f1ae4381, NAME => 'ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:37,505 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0d12514b202d3cc96021e2315962764c, NAME => 'ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 897ed1e72710a942b6f8cdb46e38cc74, disabling compactions & flushes 2023-02-11 00:55:37,511 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. after waiting 0 ms 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:37,511 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:37,511 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 897ed1e72710a942b6f8cdb46e38cc74: Waiting for close lock at 1676076937511Disabling compacts and flushes for region at 1676076937511Disabling writes for close at 1676076937511Writing region close event to WAL at 1676076937511Closed at 1676076937511 2023-02-11 00:55:37,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:37,873 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family1/12d357db681b4dc98dba31e0987b7ed4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/12d357db681b4dc98dba31e0987b7ed4 2023-02-11 00:55:37,878 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in cc1065bd3f43e44e7e6d2a0b5c404d8f/family1 of cc1065bd3f43e44e7e6d2a0b5c404d8f into 12d357db681b4dc98dba31e0987b7ed4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:37,878 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676076936539; duration=1sec 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. because compaction request was cancelled 2023-02-11 00:55:37,878 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 00:55:37,881 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 00:55:37,881 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1912): cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 is initiating minor compaction (all files) 2023-02-11 00:55:37,881 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 in testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:55:37,881 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp, totalSize=20.4 K 2023-02-11 00:55:37,882 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912678 2023-02-11 00:55:37,883 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914492 2023-02-11 00:55:37,883 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916293 2023-02-11 00:55:37,884 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:37,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_] to archive 2023-02-11 00:55:37,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:37,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-d6ae4ebf39b94193899e1b35e991e82d 2023-02-11 00:55:37,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-ecae5951760a4fc3b122d460705fe026 2023-02-11 00:55:37,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-72b7675bdfa847d3a18ad4805361cd7f 2023-02-11 00:55:37,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-8652069ddf80480f8c63f073a6856362 2023-02-11 00:55:37,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family1/a61f1fa1f9554906b02c34aeae6160c5_SeqId_34_ 2023-02-11 00:55:37,898 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): cc1065bd3f43e44e7e6d2a0b5c404d8f#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 80edaca03d31c7d428645cb0f1ae4381, disabling compactions & flushes 2023-02-11 00:55:37,911 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. after waiting 0 ms 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:37,911 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 0d12514b202d3cc96021e2315962764c, disabling compactions & flushes 2023-02-11 00:55:37,911 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:37,911 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:37,912 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 80edaca03d31c7d428645cb0f1ae4381: Waiting for close lock at 1676076937911Disabling compacts and flushes for region at 1676076937911Disabling writes for close at 1676076937911Writing region close event to WAL at 1676076937911Closed at 1676076937911 2023-02-11 00:55:37,912 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:37,912 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. after waiting 0 ms 2023-02-11 00:55:37,912 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:37,912 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:37,912 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 0d12514b202d3cc96021e2315962764c: Waiting for close lock at 1676076937911Disabling compacts and flushes for region at 1676076937911Disabling writes for close at 1676076937912 (+1 ms)Writing region close event to WAL at 1676076937912Closed at 1676076937912 2023-02-11 00:55:37,914 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:55:37,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076937915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076937915"}]},"ts":"1676076937915"} 2023-02-11 00:55:37,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076937915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076937915"}]},"ts":"1676076937915"} 2023-02-11 00:55:37,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676076937915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076937915"}]},"ts":"1676076937915"} 2023-02-11 00:55:37,917 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 00:55:37,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:55:37,918 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076937918"}]},"ts":"1676076937918"} 2023-02-11 00:55:37,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-11 00:55:37,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80edaca03d31c7d428645cb0f1ae4381, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0d12514b202d3cc96021e2315962764c, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=897ed1e72710a942b6f8cdb46e38cc74, ASSIGN}] 2023-02-11 00:55:37,923 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=897ed1e72710a942b6f8cdb46e38cc74, ASSIGN 2023-02-11 00:55:37,923 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0d12514b202d3cc96021e2315962764c, ASSIGN 2023-02-11 00:55:37,923 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80edaca03d31c7d428645cb0f1ae4381, ASSIGN 2023-02-11 00:55:37,924 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=897ed1e72710a942b6f8cdb46e38cc74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:37,924 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0d12514b202d3cc96021e2315962764c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:37,924 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80edaca03d31c7d428645cb0f1ae4381, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:37,962 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:55:38,076 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0d12514b202d3cc96021e2315962764c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,076 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=897ed1e72710a942b6f8cdb46e38cc74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,076 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=80edaca03d31c7d428645cb0f1ae4381, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,077 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676076938076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076938076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076938076"}]},"ts":"1676076938076"} 2023-02-11 00:55:38,077 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076938076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076938076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076938076"}]},"ts":"1676076938076"} 2023-02-11 00:55:38,077 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076938076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076938076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076938076"}]},"ts":"1676076938076"} 2023-02-11 00:55:38,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 0d12514b202d3cc96021e2315962764c, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:38,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 897ed1e72710a942b6f8cdb46e38cc74, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:38,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 80edaca03d31c7d428645cb0f1ae4381, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:38,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:38,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:38,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 897ed1e72710a942b6f8cdb46e38cc74, NAME => 'ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 00:55:38,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:38,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,233 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,234 DEBUG [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1 2023-02-11 00:55:38,234 DEBUG [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1 2023-02-11 00:55:38,235 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 897ed1e72710a942b6f8cdb46e38cc74 columnFamilyName family1 2023-02-11 00:55:38,236 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] regionserver.HStore(310): Store=897ed1e72710a942b6f8cdb46e38cc74/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,236 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,237 DEBUG [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2 2023-02-11 00:55:38,237 DEBUG [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2 2023-02-11 00:55:38,237 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 897ed1e72710a942b6f8cdb46e38cc74 columnFamilyName family2 2023-02-11 00:55:38,238 INFO [StoreOpener-897ed1e72710a942b6f8cdb46e38cc74-1] regionserver.HStore(310): Store=897ed1e72710a942b6f8cdb46e38cc74/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:38,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:55:38,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:38,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 897ed1e72710a942b6f8cdb46e38cc74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73428370, jitterRate=0.09416797757148743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:38,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 897ed1e72710a942b6f8cdb46e38cc74: Running coprocessor pre-open hook at 1676076938232Writing region info on filesystem at 1676076938232Initializing all the Stores at 1676076938233 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938233Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938233Cleaning up temporary data from old regions at 1676076938240 (+7 ms)Cleaning up detritus from prior splits at 1676076938240Running coprocessor post-open hooks at 1676076938243 (+3 ms)Region opened successfully at 1676076938243 2023-02-11 00:55:38,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74., pid=110, masterSystemTime=1676076938229 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:38,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:38,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d12514b202d3cc96021e2315962764c, NAME => 'ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 00:55:38,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=897ed1e72710a942b6f8cdb46e38cc74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:38,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076938245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076938245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076938245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076938245"}]},"ts":"1676076938245"} 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,246 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,247 DEBUG [StoreOpener-0d12514b202d3cc96021e2315962764c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1 2023-02-11 00:55:38,247 DEBUG [StoreOpener-0d12514b202d3cc96021e2315962764c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1 2023-02-11 00:55:38,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-02-11 00:55:38,248 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d12514b202d3cc96021e2315962764c columnFamilyName family1 2023-02-11 00:55:38,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 897ed1e72710a942b6f8cdb46e38cc74, server=jenkins-hbase4.apache.org,43697,1676076813915 in 168 msec 2023-02-11 00:55:38,248 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] regionserver.HStore(310): Store=0d12514b202d3cc96021e2315962764c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=897ed1e72710a942b6f8cdb46e38cc74, ASSIGN in 326 msec 2023-02-11 00:55:38,249 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,250 DEBUG [StoreOpener-0d12514b202d3cc96021e2315962764c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2 2023-02-11 00:55:38,250 DEBUG [StoreOpener-0d12514b202d3cc96021e2315962764c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2 2023-02-11 00:55:38,250 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d12514b202d3cc96021e2315962764c columnFamilyName family2 2023-02-11 00:55:38,250 INFO [StoreOpener-0d12514b202d3cc96021e2315962764c-1] regionserver.HStore(310): Store=0d12514b202d3cc96021e2315962764c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:38,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d12514b202d3cc96021e2315962764c 2023-02-11 00:55:38,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:38,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d12514b202d3cc96021e2315962764c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67574091, jitterRate=0.006932422518730164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:38,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d12514b202d3cc96021e2315962764c: Running coprocessor pre-open hook at 1676076938246Writing region info on filesystem at 1676076938246Initializing all the Stores at 1676076938246Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938246Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938246Cleaning up temporary data from old regions at 1676076938252 (+6 ms)Cleaning up detritus from prior splits at 1676076938252Running coprocessor post-open hooks at 1676076938255 (+3 ms)Region opened successfully at 1676076938255 2023-02-11 00:55:38,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c., pid=109, masterSystemTime=1676076938229 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:38,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:38,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80edaca03d31c7d428645cb0f1ae4381, NAME => 'ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 00:55:38,257 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0d12514b202d3cc96021e2315962764c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676076938257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076938257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076938257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076938257"}]},"ts":"1676076938257"} 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,258 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-02-11 00:55:38,260 DEBUG [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1 2023-02-11 00:55:38,260 DEBUG [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1 2023-02-11 00:55:38,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 0d12514b202d3cc96021e2315962764c, server=jenkins-hbase4.apache.org,43697,1676076813915 in 180 msec 2023-02-11 00:55:38,260 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80edaca03d31c7d428645cb0f1ae4381 columnFamilyName family1 2023-02-11 00:55:38,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0d12514b202d3cc96021e2315962764c, ASSIGN in 338 msec 2023-02-11 00:55:38,261 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] regionserver.HStore(310): Store=80edaca03d31c7d428645cb0f1ae4381/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,261 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,262 DEBUG [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2 2023-02-11 00:55:38,262 DEBUG [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2 2023-02-11 00:55:38,262 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80edaca03d31c7d428645cb0f1ae4381 columnFamilyName family2 2023-02-11 00:55:38,263 INFO [StoreOpener-80edaca03d31c7d428645cb0f1ae4381-1] regionserver.HStore(310): Store=80edaca03d31c7d428645cb0f1ae4381/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:38,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:55:38,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:55:38,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:38,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 80edaca03d31c7d428645cb0f1ae4381; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61693420, jitterRate=-0.08069640398025513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:55:38,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 80edaca03d31c7d428645cb0f1ae4381: Running coprocessor pre-open hook at 1676076938258Writing region info on filesystem at 1676076938258Initializing all the Stores at 1676076938258Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938258Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076938258Cleaning up temporary data from old regions at 1676076938264 (+6 ms)Cleaning up detritus from prior splits at 1676076938265 (+1 ms)Running coprocessor post-open hooks at 1676076938268 (+3 ms)Region opened successfully at 1676076938268 2023-02-11 00:55:38,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381., pid=111, masterSystemTime=1676076938229 2023-02-11 00:55:38,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:38,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:38,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=80edaca03d31c7d428645cb0f1ae4381, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:38,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676076938270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076938270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076938270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076938270"}]},"ts":"1676076938270"} 2023-02-11 00:55:38,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=106 2023-02-11 00:55:38,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 80edaca03d31c7d428645cb0f1ae4381, server=jenkins-hbase4.apache.org,43697,1676076813915 in 192 msec 2023-02-11 00:55:38,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-11 00:55:38,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80edaca03d31c7d428645cb0f1ae4381, ASSIGN in 350 msec 2023-02-11 00:55:38,273 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:55:38,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076938274"}]},"ts":"1676076938274"} 2023-02-11 00:55:38,274 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-11 00:55:38,276 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:55:38,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1850 sec 2023-02-11 00:55:38,288 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family1/20551cec1bb546b3830535ce77ec6ee7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/20551cec1bb546b3830535ce77ec6ee7 2023-02-11 00:55:38,292 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b43278b0748bb249ee9de5ea2a2e7a01/family1 of b43278b0748bb249ee9de5ea2a2e7a01 into 20551cec1bb546b3830535ce77ec6ee7(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:38,292 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:38,292 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676076936932; duration=1sec 2023-02-11 00:55:38,292 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 00:55:38,292 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 00:55:38,294 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 00:55:38,294 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1912): b43278b0748bb249ee9de5ea2a2e7a01/family2 is initiating minor compaction (all files) 2023-02-11 00:55:38,294 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2258): Starting compaction of b43278b0748bb249ee9de5ea2a2e7a01/family2 in testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:55:38,294 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp, totalSize=20.4 K 2023-02-11 00:55:38,295 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076912677 2023-02-11 00:55:38,295 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076914491 2023-02-11 00:55:38,296 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076916292 2023-02-11 00:55:38,296 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076918094 2023-02-11 00:55:38,308 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] throttle.PressureAwareThroughputController(145): b43278b0748bb249ee9de5ea2a2e7a01#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:55:38,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_] to archive 2023-02-11 00:55:38,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:38,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a030230415a74159860fa283bc3c028a 2023-02-11 00:55:38,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-fadc1cb32e91426e8c30a0e692753945 2023-02-11 00:55:38,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-a1c47e823423480d85e744c0acb7e14b 2023-02-11 00:55:38,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-49f23577e1464a5bbe2990b8a6b4ab81 2023-02-11 00:55:38,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family1/65d4d9d4b3e3418e8d7ccfe3fbd4ae07_SeqId_34_ 2023-02-11 00:55:39,114 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/.tmp/family2/6694960d796b426182c33c0619e7b91f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/6694960d796b426182c33c0619e7b91f 2023-02-11 00:55:39,118 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in cc1065bd3f43e44e7e6d2a0b5c404d8f/family2 of cc1065bd3f43e44e7e6d2a0b5c404d8f into 6694960d796b426182c33c0619e7b91f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:39,118 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: 2023-02-11 00:55:39,118 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f., storeName=cc1065bd3f43e44e7e6d2a0b5c404d8f/family2, priority=12, startTime=1676076935932; duration=1sec 2023-02-11 00:55:39,118 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 00:55:39,118 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-11 00:55:39,119 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 00:55:39,119 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 00:55:39,119 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. because compaction request was cancelled 2023-02-11 00:55:39,122 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/.tmp/family2/2f559ac5ce0449019b1d8f7b8e0714ef as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/2f559ac5ce0449019b1d8f7b8e0714ef 2023-02-11 00:55:39,126 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b43278b0748bb249ee9de5ea2a2e7a01/family2 of b43278b0748bb249ee9de5ea2a2e7a01 into 2f559ac5ce0449019b1d8f7b8e0714ef(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:55:39,126 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for b43278b0748bb249ee9de5ea2a2e7a01: 2023-02-11 00:55:39,126 INFO [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01., storeName=b43278b0748bb249ee9de5ea2a2e7a01/family2, priority=12, startTime=1676076935854; duration=0sec 2023-02-11 00:55:39,126 DEBUG [RS:0;jenkins-hbase4:43697-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:55:39,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359] to archive 2023-02-11 00:55:39,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:39,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-7b6e3545312d4eca94b9645ba9054834 2023-02-11 00:55:39,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-39edbd4aaa8e41189f90c5c00830912f 2023-02-11 00:55:39,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-0f00443bccd446a5b46914a4ef290a1d 2023-02-11 00:55:39,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/family2/testCompactionWithHFileLink=b43278b0748bb249ee9de5ea2a2e7a01-3d6da15792b440cea8f524c14dec2359 2023-02-11 00:55:39,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29] to archive 2023-02-11 00:55:39,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:39,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-21cb0c1a64494fa2b6f78a61cb3c73a4 2023-02-11 00:55:39,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-054fdb4bc4554831a1aaa6ae48df102b 2023-02-11 00:55:39,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-68d4c0df6f32497e9e06d60619a4ba97 2023-02-11 00:55:39,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/family2/testCompactionWithHFileLink=cc1065bd3f43e44e7e6d2a0b5c404d8f-c89e59e7afa542968fcb3ab138c8aa29 2023-02-11 00:55:39,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 00:55:39,199 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-11 00:55:39,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:39,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:39,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:39,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:39,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 00:55:39,209 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 00:55:39,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:39,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 00:55:39,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 00:55:39,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:39,209 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:39,210 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:39,210 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:39,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:39,211 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:39,211 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:39,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:39,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 00:55:39,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 00:55:39,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 00:55:39,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:39,212 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 00:55:39,212 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:39,212 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. started... 2023-02-11 00:55:39,215 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 80edaca03d31c7d428645cb0f1ae4381 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:39,215 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:39,215 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. started... 2023-02-11 00:55:39,215 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:39,216 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. started... 2023-02-11 00:55:39,216 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d12514b202d3cc96021e2315962764c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:39,216 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 897ed1e72710a942b6f8cdb46e38cc74 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:55:39,627 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021197df51ed87f64f2abdb42a184c8a3e6f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021197df51ed87f64f2abdb42a184c8a3e6f 2023-02-11 00:55:39,627 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114c83f90e16f645d5ab37989a9b69e65b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302114c83f90e16f645d5ab37989a9b69e65b 2023-02-11 00:55:39,628 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302115fc3666434de40b98d353843bad8ea1e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302115fc3666434de40b98d353843bad8ea1e 2023-02-11 00:55:40,032 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/b09f388b33b54674a0335251268771f7 2023-02-11 00:55:40,033 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/464e4edb38c94adf8ac05851510ab741 2023-02-11 00:55:40,033 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/bf14d31bcde543a583f3c8a02968115f 2023-02-11 00:55:40,454 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302115c193dc26fbc498ca2e673ac7622f1fa to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302115c193dc26fbc498ca2e673ac7622f1fa 2023-02-11 00:55:40,454 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021125d46c8cf8884930be31a53fd135ff1b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021125d46c8cf8884930be31a53fd135ff1b 2023-02-11 00:55:40,456 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302118b3c91ad00e447de899d9a02c45672bc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302118b3c91ad00e447de899d9a02c45672bc 2023-02-11 00:55:40,460 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/012a6c270fa14b1d980cfca322f381d1 2023-02-11 00:55:40,464 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/b09f388b33b54674a0335251268771f7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7 2023-02-11 00:55:40,467 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:40,467 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/012a6c270fa14b1d980cfca322f381d1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1 2023-02-11 00:55:40,470 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:40,471 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0d12514b202d3cc96021e2315962764c in 1255ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:40,471 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-11 00:55:40,472 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:40,472 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:40,472 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:40,860 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/aa48281100d84442b91765da80cdb480 2023-02-11 00:55:40,860 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/0e26abca84874600b7a3abb3f95925b0 2023-02-11 00:55:40,864 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/464e4edb38c94adf8ac05851510ab741 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741 2023-02-11 00:55:40,864 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/bf14d31bcde543a583f3c8a02968115f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f 2023-02-11 00:55:40,867 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:40,867 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 00:55:40,867 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/aa48281100d84442b91765da80cdb480 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480 2023-02-11 00:55:40,868 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/0e26abca84874600b7a3abb3f95925b0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0 2023-02-11 00:55:40,871 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:40,871 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:55:40,871 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 80edaca03d31c7d428645cb0f1ae4381 in 1656ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:40,871 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 897ed1e72710a942b6f8cdb46e38cc74 in 1655ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:40,872 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:40,872 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:40,872 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:40,872 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 00:55:40,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 00:55:40,875 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,875 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:40,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,876 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:40,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 00:55:40,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345616a4[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:40,877 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 00:55:40,877 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,878 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 00:55:40,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 00:55:40,878 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:40,878 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,878 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:40,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 00:55:40,880 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:40,880 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:40,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 00:55:40,882 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 00:55:40,882 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:40,882 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:40,882 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 00:55:40,882 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:40,883 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,883 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:40,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:40,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,883 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:40,884 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:40,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:40,889 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:40,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:40,892 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:40,892 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 00:55:40,893 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:40,892 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:40,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:40,893 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:40,893 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:40,893 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:40,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 00:55:40,893 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:40,893 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:40,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:40,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:40,993 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:40,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:40,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:40,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:40,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:40,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 00:55:40,999 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 00:55:40,999 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:41,000 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 00:55:41,000 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 00:55:41,000 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:41,000 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:41,001 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:41,001 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:41,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:41,002 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:41,002 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:41,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 00:55:41,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 00:55:41,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 00:55:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 00:55:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. started... 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:41,003 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 80edaca03d31c7d428645cb0f1ae4381 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. started... 2023-02-11 00:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. started... 2023-02-11 00:55:41,003 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d12514b202d3cc96021e2315962764c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:41,003 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 897ed1e72710a942b6f8cdb46e38cc74 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:55:41,017 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f672f7dae21a414cad31d510203e94e5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211f672f7dae21a414cad31d510203e94e5 2023-02-11 00:55:41,417 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c54e1def09274f109350084afa83de68 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211c54e1def09274f109350084afa83de68 2023-02-11 00:55:41,418 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211c416c9acd15b42519a29b369aa34dee8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211c416c9acd15b42519a29b369aa34dee8 2023-02-11 00:55:41,421 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/d1580814ac8e46b1971fed5e397bc1b0 2023-02-11 00:55:41,822 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/9b7ed63720c6472cb069ed7784ba1ea1 2023-02-11 00:55:41,822 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/49218becbf4d41058b8adf5671221ef4 2023-02-11 00:55:41,835 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e3c61eda5bc24a0083d0ab9231fe643d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211e3c61eda5bc24a0083d0ab9231fe643d 2023-02-11 00:55:41,839 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211a827aa6c88ee4d50820a1c5ea2f0d6f9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211a827aa6c88ee4d50820a1c5ea2f0d6f9 2023-02-11 00:55:41,868 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d 2023-02-11 00:55:41,869 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/0f63b56a80ec4230ad8a97c4dc8372db 2023-02-11 00:55:41,874 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/d1580814ac8e46b1971fed5e397bc1b0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0 2023-02-11 00:55:41,874 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/9b7ed63720c6472cb069ed7784ba1ea1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1 2023-02-11 00:55:41,880 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:41,880 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:41,881 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/0f63b56a80ec4230ad8a97c4dc8372db as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db 2023-02-11 00:55:41,881 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d 2023-02-11 00:55:41,886 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:41,886 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:41,887 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 80edaca03d31c7d428645cb0f1ae4381 in 884ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:41,887 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0d12514b202d3cc96021e2315962764c in 884ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:41,887 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:41,887 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:41,887 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:41,887 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:41,887 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:41,887 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:42,238 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b3f26065b4da4814af99ef54b7b565df to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211b3f26065b4da4814af99ef54b7b565df 2023-02-11 00:55:42,644 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/d9ba14a9b6eb4489b8fccc5e2eb91780 2023-02-11 00:55:42,647 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/49218becbf4d41058b8adf5671221ef4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4 2023-02-11 00:55:42,650 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 00:55:42,651 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/d9ba14a9b6eb4489b8fccc5e2eb91780 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780 2023-02-11 00:55:42,654 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:55:42,655 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 897ed1e72710a942b6f8cdb46e38cc74 in 1652ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:42,655 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:42,655 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:42,655 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:42,655 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:42,655 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,655 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 00:55:42,655 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 00:55:42,656 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,656 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:42,657 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,657 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 00:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@311bdd87[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:42,658 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 00:55:42,658 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,659 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,659 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 00:55:42,659 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 00:55:42,659 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:42,659 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,659 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:42,667 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:42,667 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 00:55:42,668 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:42,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,668 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 00:55:42,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:42,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:42,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 00:55:42,669 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 00:55:42,669 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:42,669 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:42,670 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 00:55:42,670 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:42,671 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,671 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:42,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:42,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,671 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:42,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:42,672 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:42,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,673 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:42,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:42,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,676 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:42,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:42,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:42,677 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:42,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 00:55:42,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:42,677 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:42,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:42,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:42,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 00:55:42,778 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:42,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:42,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:42,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:42,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:42,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:42,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:42,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 00:55:42,784 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 00:55:42,784 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:42,784 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 00:55:42,784 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 00:55:42,784 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,784 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:42,786 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:42,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:42,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:42,786 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:42,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:42,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 00:55:42,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 00:55:42,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 00:55:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 00:55:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. started... 2023-02-11 00:55:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:42,790 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 80edaca03d31c7d428645cb0f1ae4381 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. started... 2023-02-11 00:55:42,790 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. started... 2023-02-11 00:55:42,790 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 897ed1e72710a942b6f8cdb46e38cc74 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:42,790 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d12514b202d3cc96021e2315962764c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:55:42,816 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211d2337432499b4caf88d3c91213048378 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211d2337432499b4caf88d3c91213048378 2023-02-11 00:55:42,817 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114feca32d90b149119fa44f5443e672b1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302114feca32d90b149119fa44f5443e672b1 2023-02-11 00:55:42,824 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/fcb0199884f747549fd059da558a10e9 2023-02-11 00:55:42,825 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/4b0bf5dd13de415cb05df59e997ad065 2023-02-11 00:55:42,862 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302114a26bbc233204081b0453ace316b25a4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302114a26bbc233204081b0453ace316b25a4 2023-02-11 00:55:42,865 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ed7e0e04f488410d81b7e322dd2cefca to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211ed7e0e04f488410d81b7e322dd2cefca 2023-02-11 00:55:43,217 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211afdcc0dcc5744f55ac933acf4cce3586 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211afdcc0dcc5744f55ac933acf4cce3586 2023-02-11 00:55:43,267 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/87bab044550f42058c7829e343977315 2023-02-11 00:55:43,269 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/2e951e1bf13f410ba83e71d5dad2e852 2023-02-11 00:55:43,271 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/fcb0199884f747549fd059da558a10e9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9 2023-02-11 00:55:43,272 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/4b0bf5dd13de415cb05df59e997ad065 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065 2023-02-11 00:55:43,274 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:43,275 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/87bab044550f42058c7829e343977315 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315 2023-02-11 00:55:43,276 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:43,277 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/2e951e1bf13f410ba83e71d5dad2e852 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852 2023-02-11 00:55:43,278 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:43,279 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 80edaca03d31c7d428645cb0f1ae4381 in 489ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:43,279 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:43,279 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:43,279 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:43,280 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:43,281 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 897ed1e72710a942b6f8cdb46e38cc74 in 491ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:43,281 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:43,281 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:43,281 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:43,622 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/cbe71e3c0dc64881b281de9bdcc5551a 2023-02-11 00:55:43,734 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:55:44,034 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211453ce26d4fa54a4b8b35e83b3b5d2a27 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211453ce26d4fa54a4b8b35e83b3b5d2a27 2023-02-11 00:55:44,439 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/8dcb913d5ca44a688c5d4954ecdde3ea 2023-02-11 00:55:44,442 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/cbe71e3c0dc64881b281de9bdcc5551a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a 2023-02-11 00:55:44,445 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 00:55:44,446 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/8dcb913d5ca44a688c5d4954ecdde3ea as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea 2023-02-11 00:55:44,449 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:55:44,450 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0d12514b202d3cc96021e2315962764c in 1660ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:44,450 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:44,450 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 00:55:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 00:55:44,453 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,453 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:44,453 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,453 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 00:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a3c66e3[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:44,455 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 00:55:44,455 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,456 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,456 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 00:55:44,456 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 00:55:44,456 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:44,457 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,457 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:44,458 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 00:55:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 00:55:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:44,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:44,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 00:55:44,461 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 00:55:44,461 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:44,461 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:44,461 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 00:55:44,461 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:44,462 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,462 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:44,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,462 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:44,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:44,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:44,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:44,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:44,463 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:44,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,464 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:44,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:44,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,467 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:44,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:44,468 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:44,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 00:55:44,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:44,468 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,568 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:44,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:44,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:44,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:55:44,572 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:44,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:44,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 00:55:44,574 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 00:55:44,574 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:44,574 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 00:55:44,574 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 00:55:44,575 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,575 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:44,576 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,576 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:44,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:44,576 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:44,576 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:44,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:44,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 00:55:44,577 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 00:55:44,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 00:55:44,577 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 00:55:44,577 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:44,577 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. started... 2023-02-11 00:55:44,577 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:44,577 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:44,577 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 80edaca03d31c7d428645cb0f1ae4381 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. started... 2023-02-11 00:55:44,577 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. started... 2023-02-11 00:55:44,578 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 897ed1e72710a942b6f8cdb46e38cc74 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:44,578 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d12514b202d3cc96021e2315962764c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:55:44,602 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211e4ef3986e5964d5994e80ef85d8b6ba8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211e4ef3986e5964d5994e80ef85d8b6ba8 2023-02-11 00:55:44,608 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/6b9837ac686b4133ad6009d20bddccca 2023-02-11 00:55:44,623 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302115a17ee3e20d84247a9b45061449c7d7e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302115a17ee3e20d84247a9b45061449c7d7e 2023-02-11 00:55:44,630 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/b1ef7ff4fc5c406e842527ed5faf6c2a 2023-02-11 00:55:44,634 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/6b9837ac686b4133ad6009d20bddccca as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca 2023-02-11 00:55:44,638 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:44,639 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/b1ef7ff4fc5c406e842527ed5faf6c2a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a 2023-02-11 00:55:44,643 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:44,644 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 897ed1e72710a942b6f8cdb46e38cc74 in 66ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:44,644 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:44,644 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:45,003 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211c53336c343f2477ba7963113d2029834 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211c53336c343f2477ba7963113d2029834 2023-02-11 00:55:45,010 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302117a940d4b0c5f40a8b3bd8caacc915311 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302117a940d4b0c5f40a8b3bd8caacc915311 2023-02-11 00:55:45,011 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/cb2c0818330240f08474100fc950682c 2023-02-11 00:55:45,015 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/bbba487e1bf947868715a10fde77cc50 2023-02-11 00:55:45,026 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302112374147bce624fe2811384a2c62e6be9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302112374147bce624fe2811384a2c62e6be9 2023-02-11 00:55:45,428 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021163eb1a6c06654f3d8cfd2b238d05b977 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021163eb1a6c06654f3d8cfd2b238d05b977 2023-02-11 00:55:45,431 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/e61ad5f6273f409598b07173656e9ff1 2023-02-11 00:55:45,435 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/cb2c0818330240f08474100fc950682c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c 2023-02-11 00:55:45,438 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:45,438 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/e61ad5f6273f409598b07173656e9ff1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1 2023-02-11 00:55:45,441 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:45,442 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0d12514b202d3cc96021e2315962764c in 864ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:45,442 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:45,442 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:45,442 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:45,833 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/140ea7141f2846a9be1fd7d1b904fb0d 2023-02-11 00:55:45,838 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/bbba487e1bf947868715a10fde77cc50 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50 2023-02-11 00:55:45,842 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 00:55:45,842 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/140ea7141f2846a9be1fd7d1b904fb0d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d 2023-02-11 00:55:45,851 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:55:45,852 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 80edaca03d31c7d428645cb0f1ae4381 in 1275ms, sequenceid=17, compaction requested=true 2023-02-11 00:55:45,852 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:45,852 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 00:55:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 00:55:45,854 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,854 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,855 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 00:55:45,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a463c6[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:45,856 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 00:55:45,856 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,858 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 00:55:45,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 00:55:45,858 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,858 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:45,858 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:45,861 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 00:55:45,861 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,861 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:45,861 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 00:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:45,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 00:55:45,864 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 00:55:45,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:45,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:45,864 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 00:55:45,864 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:45,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:45,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,866 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:45,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:45,867 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,869 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:45,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:45,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 00:55:45,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:45,871 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:45,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:45,871 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:45,872 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:45,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,872 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:45,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:45,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:45,972 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:45,986 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:45,996 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:46,004 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:46,005 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:46,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:46,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:46,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 00:55:46,034 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 00:55:46,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:46,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 00:55:46,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 00:55:46,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:46,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:46,035 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:46,035 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:46,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:46,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:46,036 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:46,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:46,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:46,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:46,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:46,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 00:55:46,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 00:55:46,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 00:55:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 00:55:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 00:55:46,040 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:46,040 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. started... 2023-02-11 00:55:46,040 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 80edaca03d31c7d428645cb0f1ae4381 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:46,041 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:46,041 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. started... 2023-02-11 00:55:46,041 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d12514b202d3cc96021e2315962764c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:55:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:46,042 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:46,042 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. started... 2023-02-11 00:55:46,042 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 897ed1e72710a942b6f8cdb46e38cc74 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:55:46,071 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/f85b180cd61d4c7fb82fcd7a532cc66a 2023-02-11 00:55:46,073 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/bca0767585fd4b7e9c7350b6821f27db 2023-02-11 00:55:46,076 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f85b180cd61d4c7fb82fcd7a532cc66a 2023-02-11 00:55:46,076 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bca0767585fd4b7e9c7350b6821f27db 2023-02-11 00:55:46,863 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/a4264ee40d0f4d1180d8b747b582c772 2023-02-11 00:55:46,867 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4264ee40d0f4d1180d8b747b582c772 2023-02-11 00:55:46,890 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/b88fa6f3d43445e78febce9ffb848b2f 2023-02-11 00:55:46,890 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79 2023-02-11 00:55:46,893 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b88fa6f3d43445e78febce9ffb848b2f 2023-02-11 00:55:46,893 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4cfaf6c163941ce8ccc56c5e2cd0f79 2023-02-11 00:55:46,894 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/bca0767585fd4b7e9c7350b6821f27db as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db 2023-02-11 00:55:46,894 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/f85b180cd61d4c7fb82fcd7a532cc66a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a 2023-02-11 00:55:46,897 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bca0767585fd4b7e9c7350b6821f27db 2023-02-11 00:55:46,897 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:46,897 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f85b180cd61d4c7fb82fcd7a532cc66a 2023-02-11 00:55:46,898 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:46,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/b88fa6f3d43445e78febce9ffb848b2f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f 2023-02-11 00:55:46,898 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79 2023-02-11 00:55:46,901 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b88fa6f3d43445e78febce9ffb848b2f 2023-02-11 00:55:46,901 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:46,902 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4cfaf6c163941ce8ccc56c5e2cd0f79 2023-02-11 00:55:46,902 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:46,902 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0d12514b202d3cc96021e2315962764c in 861ms, sequenceid=23, compaction requested=true 2023-02-11 00:55:46,902 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:46,902 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:46,902 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:55:46,903 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 897ed1e72710a942b6f8cdb46e38cc74 in 861ms, sequenceid=23, compaction requested=true 2023-02-11 00:55:46,903 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:46,903 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:46,903 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:55:47,677 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/3fd1afd05c2a48e892d11504c278e3d0 2023-02-11 00:55:47,681 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fd1afd05c2a48e892d11504c278e3d0 2023-02-11 00:55:47,681 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/a4264ee40d0f4d1180d8b747b582c772 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772 2023-02-11 00:55:47,685 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4264ee40d0f4d1180d8b747b582c772 2023-02-11 00:55:47,685 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:47,685 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/3fd1afd05c2a48e892d11504c278e3d0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0 2023-02-11 00:55:47,689 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fd1afd05c2a48e892d11504c278e3d0 2023-02-11 00:55:47,689 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:55:47,690 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 80edaca03d31c7d428645cb0f1ae4381 in 1650ms, sequenceid=23, compaction requested=true 2023-02-11 00:55:47,690 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:47,690 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:47,690 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:55:47,690 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:55:47,690 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,690 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 00:55:47,690 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 00:55:47,692 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,692 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:47,692 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,692 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:47,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:47,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 00:55:47,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@618e6502[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:47,694 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 00:55:47,694 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,696 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,696 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 00:55:47,696 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 00:55:47,696 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:47,696 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,696 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:47,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 00:55:47,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:47,698 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,698 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 00:55:47,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:47,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:47,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:47,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 00:55:47,701 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 00:55:47,701 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:47,701 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:47,701 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 00:55:47,701 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:47,705 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,705 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:47,705 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:47,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,706 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:47,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:47,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,707 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:47,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 00:55:47,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:47,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:47,710 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:47,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 00:55:47,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 00:55:47,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:47,710 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:47,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:47,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 00:55:47,711 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 00:55:47,711 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:47,711 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:47,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:47,811 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:47,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:47,812 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:47,813 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 80edaca03d31c7d428645cb0f1ae4381/family1 is initiating major compaction (all files) 2023-02-11 00:55:47,813 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:47,813 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:47,813 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 80edaca03d31c7d428645cb0f1ae4381/family1 in ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:47,813 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp, totalSize=26.6 K 2023-02-11 00:55:47,814 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 464e4edb38c94adf8ac05851510ab741, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:47,814 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 9b7ed63720c6472cb069ed7784ba1ea1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:47,815 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting fcb0199884f747549fd059da558a10e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942779 2023-02-11 00:55:47,815 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting bbba487e1bf947868715a10fde77cc50, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:47,816 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting a4264ee40d0f4d1180d8b747b582c772, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:47,825 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 80edaca03d31c7d428645cb0f1ae4381#family1#compaction#149 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:48,233 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211dd80d12db97d402fb81c08fb8c895bc7_del 2023-02-11 00:55:48,233 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211dd80d12db97d402fb81c08fb8c895bc7_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211dd80d12db97d402fb81c08fb8c895bc7_del 2023-02-11 00:55:49,047 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49778b0bc0194b789738b9edcf4b3cfc 2023-02-11 00:55:49,048 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family1/49778b0bc0194b789738b9edcf4b3cfc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/49778b0bc0194b789738b9edcf4b3cfc 2023-02-11 00:55:49,052 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49778b0bc0194b789738b9edcf4b3cfc 2023-02-11 00:55:49,053 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80edaca03d31c7d428645cb0f1ae4381/family1 of 80edaca03d31c7d428645cb0f1ae4381 into 49778b0bc0194b789738b9edcf4b3cfc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:49,053 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:49,053 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:49,053 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 80edaca03d31c7d428645cb0f1ae4381/family2 is initiating major compaction (all files) 2023-02-11 00:55:49,053 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:49,053 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:49,054 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 80edaca03d31c7d428645cb0f1ae4381/family2 in ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:55:49,054 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp, totalSize=25.3 K 2023-02-11 00:55:49,054 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting aa48281100d84442b91765da80cdb480, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:49,055 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0f63b56a80ec4230ad8a97c4dc8372db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:49,055 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 87bab044550f42058c7829e343977315, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942779 2023-02-11 00:55:49,055 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 140ea7141f2846a9be1fd7d1b904fb0d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:49,055 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 3fd1afd05c2a48e892d11504c278e3d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:49,063 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 80edaca03d31c7d428645cb0f1ae4381#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:49,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772] to archive 2023-02-11 00:55:49,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:49,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/464e4edb38c94adf8ac05851510ab741 2023-02-11 00:55:49,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/9b7ed63720c6472cb069ed7784ba1ea1 2023-02-11 00:55:49,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/fcb0199884f747549fd059da558a10e9 2023-02-11 00:55:49,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/bbba487e1bf947868715a10fde77cc50 2023-02-11 00:55:49,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/a4264ee40d0f4d1180d8b747b582c772 2023-02-11 00:55:49,470 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211d22347f2b6f944088b02a5b0a0d84542_del 2023-02-11 00:55:49,471 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211d22347f2b6f944088b02a5b0a0d84542_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211d22347f2b6f944088b02a5b0a0d84542_del 2023-02-11 00:55:50,283 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78387665dde64b71a4514e86b87c5b48 2023-02-11 00:55:50,283 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/.tmp/family2/78387665dde64b71a4514e86b87c5b48 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/78387665dde64b71a4514e86b87c5b48 2023-02-11 00:55:50,287 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78387665dde64b71a4514e86b87c5b48 2023-02-11 00:55:50,288 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80edaca03d31c7d428645cb0f1ae4381/family2 of 80edaca03d31c7d428645cb0f1ae4381 into 78387665dde64b71a4514e86b87c5b48(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:50,288 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:50,288 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:50,288 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 0d12514b202d3cc96021e2315962764c/family1 is initiating major compaction (all files) 2023-02-11 00:55:50,288 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:50,288 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:50,289 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 0d12514b202d3cc96021e2315962764c/family1 in ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:50,289 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp, totalSize=26.6 K 2023-02-11 00:55:50,289 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting b09f388b33b54674a0335251268771f7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:50,289 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting d1580814ac8e46b1971fed5e397bc1b0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:50,290 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting cbe71e3c0dc64881b281de9bdcc5551a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942780 2023-02-11 00:55:50,290 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting cb2c0818330240f08474100fc950682c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:50,291 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting bca0767585fd4b7e9c7350b6821f27db, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:50,299 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 0d12514b202d3cc96021e2315962764c#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:50,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0] to archive 2023-02-11 00:55:50,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:50,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/aa48281100d84442b91765da80cdb480 2023-02-11 00:55:50,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/0f63b56a80ec4230ad8a97c4dc8372db 2023-02-11 00:55:50,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/87bab044550f42058c7829e343977315 2023-02-11 00:55:50,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/140ea7141f2846a9be1fd7d1b904fb0d 2023-02-11 00:55:50,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family2/3fd1afd05c2a48e892d11504c278e3d0 2023-02-11 00:55:50,706 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211983dafb082cb48b9869f059960d7026b_del 2023-02-11 00:55:50,706 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211983dafb082cb48b9869f059960d7026b_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211983dafb082cb48b9869f059960d7026b_del 2023-02-11 00:55:51,519 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 607e8665379d4aba8dd057fcbec538ae 2023-02-11 00:55:51,520 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family1/607e8665379d4aba8dd057fcbec538ae as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/607e8665379d4aba8dd057fcbec538ae 2023-02-11 00:55:51,523 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 607e8665379d4aba8dd057fcbec538ae 2023-02-11 00:55:51,523 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d12514b202d3cc96021e2315962764c/family1 of 0d12514b202d3cc96021e2315962764c into 607e8665379d4aba8dd057fcbec538ae(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:51,524 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:51,524 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:51,524 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 0d12514b202d3cc96021e2315962764c/family2 is initiating major compaction (all files) 2023-02-11 00:55:51,524 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:51,524 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:51,524 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 0d12514b202d3cc96021e2315962764c/family2 in ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:55:51,524 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp, totalSize=25.3 K 2023-02-11 00:55:51,525 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 012a6c270fa14b1d980cfca322f381d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:51,525 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting c2e125f7e8bc4e6e8b155d4ee0d9aa2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:51,525 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 8dcb913d5ca44a688c5d4954ecdde3ea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942780 2023-02-11 00:55:51,526 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting e61ad5f6273f409598b07173656e9ff1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:51,526 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting b88fa6f3d43445e78febce9ffb848b2f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:51,535 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 0d12514b202d3cc96021e2315962764c#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:51,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db] to archive 2023-02-11 00:55:51,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:51,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/b09f388b33b54674a0335251268771f7 2023-02-11 00:55:51,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/d1580814ac8e46b1971fed5e397bc1b0 2023-02-11 00:55:51,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cbe71e3c0dc64881b281de9bdcc5551a 2023-02-11 00:55:51,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/cb2c0818330240f08474100fc950682c 2023-02-11 00:55:51,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/bca0767585fd4b7e9c7350b6821f27db 2023-02-11 00:55:51,945 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021136efde0f7cb742408acdc0ef9633407f_del 2023-02-11 00:55:51,945 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021136efde0f7cb742408acdc0ef9633407f_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021136efde0f7cb742408acdc0ef9633407f_del 2023-02-11 00:55:52,758 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 590ef2ca86b646b9b8d1b13fdf61e2c9 2023-02-11 00:55:52,759 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/.tmp/family2/590ef2ca86b646b9b8d1b13fdf61e2c9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/590ef2ca86b646b9b8d1b13fdf61e2c9 2023-02-11 00:55:52,763 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 590ef2ca86b646b9b8d1b13fdf61e2c9 2023-02-11 00:55:52,764 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0d12514b202d3cc96021e2315962764c/family2 of 0d12514b202d3cc96021e2315962764c into 590ef2ca86b646b9b8d1b13fdf61e2c9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:52,764 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:52,764 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:52,764 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 897ed1e72710a942b6f8cdb46e38cc74/family1 is initiating major compaction (all files) 2023-02-11 00:55:52,764 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:52,764 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:52,764 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 897ed1e72710a942b6f8cdb46e38cc74/family1 in ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:52,764 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp, totalSize=26.6 K 2023-02-11 00:55:52,765 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting bf14d31bcde543a583f3c8a02968115f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:52,765 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 49218becbf4d41058b8adf5671221ef4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:52,765 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 4b0bf5dd13de415cb05df59e997ad065, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942780 2023-02-11 00:55:52,766 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 6b9837ac686b4133ad6009d20bddccca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:52,766 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting f85b180cd61d4c7fb82fcd7a532cc66a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:52,774 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 897ed1e72710a942b6f8cdb46e38cc74#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:52,782 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302118861c5b6674c4867b9cc1cab08b89ba4_del 2023-02-11 00:55:52,782 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302118861c5b6674c4867b9cc1cab08b89ba4_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302118861c5b6674c4867b9cc1cab08b89ba4_del 2023-02-11 00:55:52,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f] to archive 2023-02-11 00:55:52,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:52,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/012a6c270fa14b1d980cfca322f381d1 2023-02-11 00:55:52,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/c2e125f7e8bc4e6e8b155d4ee0d9aa2d 2023-02-11 00:55:52,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/8dcb913d5ca44a688c5d4954ecdde3ea 2023-02-11 00:55:52,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/e61ad5f6273f409598b07173656e9ff1 2023-02-11 00:55:52,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family2/b88fa6f3d43445e78febce9ffb848b2f 2023-02-11 00:55:53,597 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2f4accb7ca94e9fa98053db020d9052 2023-02-11 00:55:53,597 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family1/b2f4accb7ca94e9fa98053db020d9052 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/b2f4accb7ca94e9fa98053db020d9052 2023-02-11 00:55:53,602 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2f4accb7ca94e9fa98053db020d9052 2023-02-11 00:55:53,603 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 897ed1e72710a942b6f8cdb46e38cc74/family1 of 897ed1e72710a942b6f8cdb46e38cc74 into b2f4accb7ca94e9fa98053db020d9052(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:55:53,603 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:53,604 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:55:53,604 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 897ed1e72710a942b6f8cdb46e38cc74/family2 is initiating major compaction (all files) 2023-02-11 00:55:53,604 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:55:53,604 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:55:53,605 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 897ed1e72710a942b6f8cdb46e38cc74/family2 in ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:55:53,605 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp, totalSize=25.3 K 2023-02-11 00:55:53,606 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0e26abca84874600b7a3abb3f95925b0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076939205 2023-02-11 00:55:53,606 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting d9ba14a9b6eb4489b8fccc5e2eb91780, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076940996 2023-02-11 00:55:53,606 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 2e951e1bf13f410ba83e71d5dad2e852, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076942780 2023-02-11 00:55:53,607 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting b1ef7ff4fc5c406e842527ed5faf6c2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076944570 2023-02-11 00:55:53,607 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting d4cfaf6c163941ce8ccc56c5e2cd0f79, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:55:53,618 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 897ed1e72710a942b6f8cdb46e38cc74#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:55:53,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a] to archive 2023-02-11 00:55:53,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:53,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/bf14d31bcde543a583f3c8a02968115f 2023-02-11 00:55:53,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/49218becbf4d41058b8adf5671221ef4 2023-02-11 00:55:53,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/4b0bf5dd13de415cb05df59e997ad065 2023-02-11 00:55:53,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/6b9837ac686b4133ad6009d20bddccca 2023-02-11 00:55:53,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/f85b180cd61d4c7fb82fcd7a532cc66a 2023-02-11 00:55:54,030 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302112f44536f6a6647c189920ef3b03b2f21_del 2023-02-11 00:55:54,030 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302112f44536f6a6647c189920ef3b03b2f21_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302112f44536f6a6647c189920ef3b03b2f21_del 2023-02-11 00:55:54,849 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfcfb0dde44a432f951a1601f00426dc 2023-02-11 00:55:54,850 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/.tmp/family2/cfcfb0dde44a432f951a1601f00426dc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/cfcfb0dde44a432f951a1601f00426dc 2023-02-11 00:55:54,855 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfcfb0dde44a432f951a1601f00426dc 2023-02-11 00:55:54,856 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 897ed1e72710a942b6f8cdb46e38cc74/family2 of 897ed1e72710a942b6f8cdb46e38cc74 into cfcfb0dde44a432f951a1601f00426dc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:55:54,856 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:54,862 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:54,865 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:54,869 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:54,870 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:54,876 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:55:54,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79] to archive 2023-02-11 00:55:54,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:54,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/0e26abca84874600b7a3abb3f95925b0 2023-02-11 00:55:54,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d9ba14a9b6eb4489b8fccc5e2eb91780 2023-02-11 00:55:54,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/2e951e1bf13f410ba83e71d5dad2e852 2023-02-11 00:55:54,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/b1ef7ff4fc5c406e842527ed5faf6c2a 2023-02-11 00:55:54,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family2/d4cfaf6c163941ce8ccc56c5e2cd0f79 2023-02-11 00:55:54,904 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-11 00:55:54,911 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211dd80d12db97d402fb81c08fb8c895bc7_del 2023-02-11 00:55:54,914 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211983dafb082cb48b9869f059960d7026b_del 2023-02-11 00:55:54,917 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302118861c5b6674c4867b9cc1cab08b89ba4_del 2023-02-11 00:55:54,918 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:54,918 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(139): Connect 0x6efb9ce3 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:55:54,924 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6008f54f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:55:54,925 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:54,925 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:54,925 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:55,372 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211ddd902f3b998402c8ba09f4acc082b59 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211ddd902f3b998402c8ba09f4acc082b59 2023-02-11 00:55:55,373 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,391 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:55:55,394 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:55:55,401 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:55:55,407 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:55:55,428 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/50231dd56a444673a704194ebf0b6f83 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-11 00:55:55,429 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/50231dd56a444673a704194ebf0b6f83}] 2023-02-11 00:55:55,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/50231dd56a444673a704194ebf0b6f83 for inclusion in 0d12514b202d3cc96021e2315962764c/family1 2023-02-11 00:55:55,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-11 00:55:55,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 00:55:55,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 0d12514b202d3cc96021e2315962764c: 2023-02-11 00:55:55,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/50231dd56a444673a704194ebf0b6f83 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__9nf6g6vj05u91saai17pbovpae6bnbicp7n167a4olc13obvkmk5amvolarcq3tf/family1/50231dd56a444673a704194ebf0b6f83 2023-02-11 00:55:55,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__9nf6g6vj05u91saai17pbovpae6bnbicp7n167a4olc13obvkmk5amvolarcq3tf/family1/50231dd56a444673a704194ebf0b6f83 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/36dd960612fc40eaa19d049c55c3c8dc_SeqId_28_ 2023-02-11 00:55:55,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__9nf6g6vj05u91saai17pbovpae6bnbicp7n167a4olc13obvkmk5amvolarcq3tf/family1/50231dd56a444673a704194ebf0b6f83 into 0d12514b202d3cc96021e2315962764c/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/36dd960612fc40eaa19d049c55c3c8dc_SeqId_28_ - updating store file list. 2023-02-11 00:55:55,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/36dd960612fc40eaa19d049c55c3c8dc_SeqId_28_ into 0d12514b202d3cc96021e2315962764c/family1 2023-02-11 00:55:55,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__9nf6g6vj05u91saai17pbovpae6bnbicp7n167a4olc13obvkmk5amvolarcq3tf/family1/50231dd56a444673a704194ebf0b6f83 into 0d12514b202d3cc96021e2315962764c/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/family1/36dd960612fc40eaa19d049c55c3c8dc_SeqId_28_) 2023-02-11 00:55:55,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__9nf6g6vj05u91saai17pbovpae6bnbicp7n167a4olc13obvkmk5amvolarcq3tf/family1/50231dd56a444673a704194ebf0b6f83 2023-02-11 00:55:55,448 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,449 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:55,457 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302115fc3666434de40b98d353843bad8ea1e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302115fc3666434de40b98d353843bad8ea1e 2023-02-11 00:55:55,457 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 00:55:55,457 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 00:55:55,457 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:55,767 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211940f4935d3824b3c80e5dcfc2beb25b4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211940f4935d3824b3c80e5dcfc2beb25b4 2023-02-11 00:55:55,768 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,780 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021154ea4cd554d54a24a33fe7480546d7e7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021154ea4cd554d54a24a33fe7480546d7e7 2023-02-11 00:55:55,781 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,791 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/8781a207756540898a80bb7b73b15e22 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-11 00:55:55,792 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/8781a207756540898a80bb7b73b15e22}] 2023-02-11 00:55:55,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/8781a207756540898a80bb7b73b15e22 for inclusion in 897ed1e72710a942b6f8cdb46e38cc74/family1 2023-02-11 00:55:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-11 00:55:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 00:55:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 897ed1e72710a942b6f8cdb46e38cc74: 2023-02-11 00:55:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/8781a207756540898a80bb7b73b15e22 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__rcfqn3ufv6idqeokinl54gfi6j671g1qfju80jjenb0ctmbk5gi5u57n34ee4sk5/family1/8781a207756540898a80bb7b73b15e22 2023-02-11 00:55:55,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__rcfqn3ufv6idqeokinl54gfi6j671g1qfju80jjenb0ctmbk5gi5u57n34ee4sk5/family1/8781a207756540898a80bb7b73b15e22 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/3530d57c72794d50a7c4fc2d4bb362a5_SeqId_28_ 2023-02-11 00:55:55,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__rcfqn3ufv6idqeokinl54gfi6j671g1qfju80jjenb0ctmbk5gi5u57n34ee4sk5/family1/8781a207756540898a80bb7b73b15e22 into 897ed1e72710a942b6f8cdb46e38cc74/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/3530d57c72794d50a7c4fc2d4bb362a5_SeqId_28_ - updating store file list. 2023-02-11 00:55:55,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/3530d57c72794d50a7c4fc2d4bb362a5_SeqId_28_ into 897ed1e72710a942b6f8cdb46e38cc74/family1 2023-02-11 00:55:55,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__rcfqn3ufv6idqeokinl54gfi6j671g1qfju80jjenb0ctmbk5gi5u57n34ee4sk5/family1/8781a207756540898a80bb7b73b15e22 into 897ed1e72710a942b6f8cdb46e38cc74/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/family1/3530d57c72794d50a7c4fc2d4bb362a5_SeqId_28_) 2023-02-11 00:55:55,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__rcfqn3ufv6idqeokinl54gfi6j671g1qfju80jjenb0ctmbk5gi5u57n34ee4sk5/family1/8781a207756540898a80bb7b73b15e22 2023-02-11 00:55:55,803 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,804 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:55,805 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302114c83f90e16f645d5ab37989a9b69e65b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302114c83f90e16f645d5ab37989a9b69e65b 2023-02-11 00:55:55,806 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 00:55:55,806 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 00:55:55,806 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:55,838 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:55,838 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4537b106 to 127.0.0.1:63942 2023-02-11 00:55:55,838 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:55,839 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:55:55,839 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x662cdd77 to 127.0.0.1:63942 2023-02-11 00:55:55,839 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:55:55,840 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/985241f1638f44ed8255af5188f5882f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-11 00:55:55,840 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/985241f1638f44ed8255af5188f5882f}] 2023-02-11 00:55:55,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/985241f1638f44ed8255af5188f5882f for inclusion in 80edaca03d31c7d428645cb0f1ae4381/family1 2023-02-11 00:55:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-11 00:55:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 00:55:55,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 80edaca03d31c7d428645cb0f1ae4381: 2023-02-11 00:55:55,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/985241f1638f44ed8255af5188f5882f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__dq4faa0mp6h10pa3fii2erb6glugah4aekjp6q8djcomem0givef5jrddj3t7ev7/family1/985241f1638f44ed8255af5188f5882f 2023-02-11 00:55:55,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__dq4faa0mp6h10pa3fii2erb6glugah4aekjp6q8djcomem0givef5jrddj3t7ev7/family1/985241f1638f44ed8255af5188f5882f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/41b48330a9ac4c1c9f36be2d4ee750f3_SeqId_28_ 2023-02-11 00:55:55,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__dq4faa0mp6h10pa3fii2erb6glugah4aekjp6q8djcomem0givef5jrddj3t7ev7/family1/985241f1638f44ed8255af5188f5882f into 80edaca03d31c7d428645cb0f1ae4381/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/41b48330a9ac4c1c9f36be2d4ee750f3_SeqId_28_ - updating store file list. 2023-02-11 00:55:55,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/41b48330a9ac4c1c9f36be2d4ee750f3_SeqId_28_ into 80edaca03d31c7d428645cb0f1ae4381/family1 2023-02-11 00:55:55,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__dq4faa0mp6h10pa3fii2erb6glugah4aekjp6q8djcomem0givef5jrddj3t7ev7/family1/985241f1638f44ed8255af5188f5882f into 80edaca03d31c7d428645cb0f1ae4381/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/family1/41b48330a9ac4c1c9f36be2d4ee750f3_SeqId_28_) 2023-02-11 00:55:55,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__ns_testMinorCompaction__dq4faa0mp6h10pa3fii2erb6glugah4aekjp6q8djcomem0givef5jrddj3t7ev7/family1/985241f1638f44ed8255af5188f5882f 2023-02-11 00:55:55,852 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,853 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:55:55,854 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021197df51ed87f64f2abdb42a184c8a3e6f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021197df51ed87f64f2abdb42a184c8a3e6f 2023-02-11 00:55:55,854 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 00:55:55,854 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 00:55:55,854 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 00:55:55,854 INFO [Listener at localhost/36341] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-11 00:55:55,857 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:55,858 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:55,861 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:55:55,862 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:55:55,878 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=253 (was 286), OpenFileDescriptor=628 (was 760), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=104 (was 113), ProcessCount=168 (was 168), AvailableMemoryMB=3287 (was 2968) - AvailableMemoryMB LEAK? - 2023-02-11 00:55:55,890 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=104, ProcessCount=168, AvailableMemoryMB=3287 2023-02-11 00:55:55,892 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 00:55:55,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:55,893 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:55:55,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-11 00:55:55,894 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:55:55,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:55,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:55,896 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c empty. 2023-02-11 00:55:55,896 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:55,896 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-11 00:55:55,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:56,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:56,302 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 00:55:56,303 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => f3292ae7467f9fa52c707ab482543b5c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:55:56,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing f3292ae7467f9fa52c707ab482543b5c, disabling compactions & flushes 2023-02-11 00:55:56,709 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. after waiting 0 ms 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:56,709 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:56,709 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for f3292ae7467f9fa52c707ab482543b5c: Waiting for close lock at 1676076956709Disabling compacts and flushes for region at 1676076956709Disabling writes for close at 1676076956709Writing region close event to WAL at 1676076956709Closed at 1676076956709 2023-02-11 00:55:56,711 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:55:56,712 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076956712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076956712"}]},"ts":"1676076956712"} 2023-02-11 00:55:56,713 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 00:55:56,714 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:55:56,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076956714"}]},"ts":"1676076956714"} 2023-02-11 00:55:56,715 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 00:55:56,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f3292ae7467f9fa52c707ab482543b5c, ASSIGN}] 2023-02-11 00:55:56,719 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f3292ae7467f9fa52c707ab482543b5c, ASSIGN 2023-02-11 00:55:56,719 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f3292ae7467f9fa52c707ab482543b5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:55:56,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f3292ae7467f9fa52c707ab482543b5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:56,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076956870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076956870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076956870"}]},"ts":"1676076956870"} 2023-02-11 00:55:56,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure f3292ae7467f9fa52c707ab482543b5c, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:55:56,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:57,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f3292ae7467f9fa52c707ab482543b5c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.', STARTKEY => '', ENDKEY => ''} 2023-02-11 00:55:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:55:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,028 INFO [StoreOpener-f3292ae7467f9fa52c707ab482543b5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,029 DEBUG [StoreOpener-f3292ae7467f9fa52c707ab482543b5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:55:57,029 DEBUG [StoreOpener-f3292ae7467f9fa52c707ab482543b5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:55:57,029 INFO [StoreOpener-f3292ae7467f9fa52c707ab482543b5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3292ae7467f9fa52c707ab482543b5c columnFamilyName family1 2023-02-11 00:55:57,030 INFO [StoreOpener-f3292ae7467f9fa52c707ab482543b5c-1] regionserver.HStore(310): Store=f3292ae7467f9fa52c707ab482543b5c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:55:57,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:55:57,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:55:57,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f3292ae7467f9fa52c707ab482543b5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69013450, jitterRate=0.028380542993545532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 00:55:57,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f3292ae7467f9fa52c707ab482543b5c: Running coprocessor pre-open hook at 1676076957027Writing region info on filesystem at 1676076957027Initializing all the Stores at 1676076957027Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676076957027Cleaning up temporary data from old regions at 1676076957034 (+7 ms)Cleaning up detritus from prior splits at 1676076957034Running coprocessor post-open hooks at 1676076957038 (+4 ms)Region opened successfully at 1676076957038 2023-02-11 00:55:57,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., pid=114, masterSystemTime=1676076957023 2023-02-11 00:55:57,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:57,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:57,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f3292ae7467f9fa52c707ab482543b5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:57,040 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676076957040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076957040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076957040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076957040"}]},"ts":"1676076957040"} 2023-02-11 00:55:57,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-11 00:55:57,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure f3292ae7467f9fa52c707ab482543b5c, server=jenkins-hbase4.apache.org,43697,1676076813915 in 169 msec 2023-02-11 00:55:57,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-11 00:55:57,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f3292ae7467f9fa52c707ab482543b5c, ASSIGN in 325 msec 2023-02-11 00:55:57,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:55:57,044 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076957044"}]},"ts":"1676076957044"} 2023-02-11 00:55:57,044 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 00:55:57,046 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:55:57,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1540 sec 2023-02-11 00:55:57,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 00:55:58,000 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-11 00:55:58,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,031 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:58,031 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:58,031 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:55:58,031 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:55:58,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,032 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,034 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:58,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:58,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:58,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,034 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:58,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:58,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,035 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:55:58,035 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:58,036 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:55:58,036 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:55:58,036 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:58,036 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:58,036 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:55:58,037 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 00:55:58,459 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c2bddbd462ad4d4d994f3965af39dbeb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c2bddbd462ad4d4d994f3965af39dbeb 2023-02-11 00:55:58,862 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/8b95cfc2405c40b4a5ea66d12801accc 2023-02-11 00:55:58,866 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/8b95cfc2405c40b4a5ea66d12801accc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc 2023-02-11 00:55:58,869 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 00:55:58,870 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 833ms, sequenceid=5, compaction requested=false 2023-02-11 00:55:58,870 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:58,870 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:55:58,870 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:55:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:55:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:55:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:55:58,872 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:58,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,872 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:58,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:55:58,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@213736d[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:58,874 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:55:58,874 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,875 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,875 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:55:58,875 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:55:58,875 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:58,875 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,875 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:58,877 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:55:58,877 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:58,877 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,877 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:55:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:58,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:55:58,879 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:55:58,879 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:58,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:58,880 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,880 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:58,882 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,882 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:58,882 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:58,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,882 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:58,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:58,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,883 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,885 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:58,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:58,886 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:58,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:58,886 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:58,986 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:58,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:58,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:58,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:58,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,993 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:58,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:58,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:55:58,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:55:58,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,993 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,995 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,995 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:58,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:58,995 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:58,995 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:58,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:58,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,996 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,996 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:55:58,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:58,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:55:58,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:58,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:55:58,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:55:58,996 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:58,996 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:58,996 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:55:58,996 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 00:55:59,408 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d2367b085cc949e899f068962e5f04ee to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2367b085cc949e899f068962e5f04ee 2023-02-11 00:55:59,813 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/d1883ec7e1d44c8db6ea1d51f234a6a6 2023-02-11 00:55:59,817 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/d1883ec7e1d44c8db6ea1d51f234a6a6 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6 2023-02-11 00:55:59,821 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 00:55:59,821 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 825ms, sequenceid=9, compaction requested=false 2023-02-11 00:55:59,821 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:55:59,821 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:55:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:55:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:55:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:55:59,823 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,823 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:55:59,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b4116b2[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:59,825 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:55:59,825 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,828 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:55:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:55:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:59,828 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,828 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:59,829 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:55:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:55:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:59,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:55:59,832 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:55:59,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:59,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:59,832 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,832 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:59,833 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,833 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,833 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,834 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,835 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:59,837 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:59,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:59,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:59,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:59,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:59,837 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:59,838 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,838 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,838 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,838 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:59,838 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:55:59,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:59,938 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:55:59,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:55:59,942 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:55:59,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:55:59,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,944 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:59,944 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:59,944 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:55:59,944 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:55:59,944 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,944 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,951 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:59,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:59,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,951 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:55:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:55:59,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,952 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,952 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:55:59,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:55:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:55:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:55:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:55:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:55:59,952 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:59,952 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:55:59,952 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:55:59,963 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016840c6c54cea4eaf98f594eba757c6c3 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016840c6c54cea4eaf98f594eba757c6c3 2023-02-11 00:55:59,967 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/e9c6f631593c4a7383f08fea936f7982 2023-02-11 00:55:59,970 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/e9c6f631593c4a7383f08fea936f7982 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982 2023-02-11 00:55:59,973 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 00:55:59,974 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 22ms, sequenceid=13, compaction requested=true 2023-02-11 00:55:59,974 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:55:59,974 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:55:59,974 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:55:59,974 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:55:59,975 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,975 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:55:59,975 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:55:59,976 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,976 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,976 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,976 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:55:59,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:55:59,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d0de44f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:55:59,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:55:59,978 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,979 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:55:59,979 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,979 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:55:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:55:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:55:59,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:55:59,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:59,980 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,980 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:55:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:55:59,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:55:59,982 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:55:59,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:55:59,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:55:59,982 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,982 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:55:59,985 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,985 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:55:59,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,985 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:55:59,985 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:55:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,986 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:55:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,988 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,988 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:55:59,988 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:55:59,988 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:55:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:55:59,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:55:59,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:55:59,988 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:55:59,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:55:59,988 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:55:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:55:59,989 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:00,089 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:00,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:00,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:00,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:00,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,095 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:00,095 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:00,095 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:00,095 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:00,096 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,096 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,097 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:00,097 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:00,097 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,097 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,098 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:00,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:00,098 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:00,098 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:00,098 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:00,098 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:00,109 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120562497832eb3247379479be61a0f41b5f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120562497832eb3247379479be61a0f41b5f 2023-02-11 00:56:00,514 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/fb418ec2570a4aa08c204def6396a5c6 2023-02-11 00:56:00,518 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/fb418ec2570a4aa08c204def6396a5c6 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6 2023-02-11 00:56:00,521 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 00:56:00,522 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 424ms, sequenceid=17, compaction requested=true 2023-02-11 00:56:00,522 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:00,522 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:00,522 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:00,522 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:00,522 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,522 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:00,522 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:00,524 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,524 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:00,524 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,524 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:00,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:00,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f393299[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:00,526 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:00,526 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,528 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,528 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:00,528 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:00,528 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:00,528 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,528 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:00,529 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:00,529 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,529 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:00,530 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:00,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:00,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:00,531 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:00,531 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:00,531 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:00,532 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,532 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:00,533 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,533 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:00,533 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:00,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:00,533 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:00,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:00,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,535 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:00,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,536 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,536 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:00,536 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:00,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:00,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,537 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:00,536 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,537 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:00,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:00,637 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:00,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:00,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:00,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:00,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,643 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:00,643 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:00,643 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:00,643 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:00,643 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,643 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,645 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,645 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:00,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:00,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:00,645 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:00,645 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,646 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:00,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:00,647 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:00,647 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:01,057 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286a2f0495b5f1401884a9405c34923d1f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286a2f0495b5f1401884a9405c34923d1f 2023-02-11 00:56:01,462 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/eadc24adcba2483a84995d5a8f979b8a 2023-02-11 00:56:01,466 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/eadc24adcba2483a84995d5a8f979b8a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a 2023-02-11 00:56:01,469 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 00:56:01,470 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 823ms, sequenceid=21, compaction requested=true 2023-02-11 00:56:01,470 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:01,470 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:01,472 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:01,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:01,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:01,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26a8b608[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:01,473 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:01,473 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,475 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:01,475 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,475 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:01,476 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,476 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:01,476 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:01,476 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:01,478 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:01,479 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:01,479 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:01,479 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,479 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:01,481 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,481 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:01,481 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:01,481 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,482 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,487 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:01,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:01,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:01,487 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:01,488 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:01,588 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:01,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:01,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:01,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:01,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,594 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:01,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:01,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:01,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:01,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,594 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,596 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,596 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:01,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:01,597 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:01,597 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,597 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,598 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:01,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:01,598 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:01,598 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:01,598 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:01,598 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:01,598 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:01,598 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:01,598 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:01,598 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:02,008 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123188355165428041ff946b8f5891f197a8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188355165428041ff946b8f5891f197a8 2023-02-11 00:56:02,413 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/a0ef67d1881a4c3288ba85f469858e2d 2023-02-11 00:56:02,417 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/a0ef67d1881a4c3288ba85f469858e2d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d 2023-02-11 00:56:02,420 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 00:56:02,421 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 823ms, sequenceid=25, compaction requested=true 2023-02-11 00:56:02,421 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:02,421 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:02,421 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:02,421 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:02,423 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:02,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:02,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@758fd0e9[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:02,425 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:02,425 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,426 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:02,426 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:02,426 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,426 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:02,427 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:02,427 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,427 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:02,427 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:02,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:02,430 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:02,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:02,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:02,430 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,430 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:02,432 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,432 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,432 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:02,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:02,432 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,433 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:02,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:02,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:02,435 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,435 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,436 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,436 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,436 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,436 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:02,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:02,436 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:02,536 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:02,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:02,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:02,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:02,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,542 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:02,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:02,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:02,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:02,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,543 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,543 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:02,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:02,543 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:02,543 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:02,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:02,545 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:02,545 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:02,545 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:02,563 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:56:02,956 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010149c87679875843beb7b52cb7af3b7818 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010149c87679875843beb7b52cb7af3b7818 2023-02-11 00:56:03,361 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/ec4c8f6d9aa045769d92ee0a535b1daf 2023-02-11 00:56:03,365 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/ec4c8f6d9aa045769d92ee0a535b1daf as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf 2023-02-11 00:56:03,368 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 00:56:03,369 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 824ms, sequenceid=29, compaction requested=true 2023-02-11 00:56:03,369 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:03,369 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:03,369 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:03,369 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:03,369 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,369 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:03,370 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:03,371 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,371 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:03,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:03,371 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,371 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:03,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:03,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37e26d8b[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:03,372 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:03,372 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,375 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:03,375 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,375 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:03,376 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:03,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:03,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:03,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:03,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:03,378 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:03,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:03,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:03,378 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,378 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:03,380 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,380 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:03,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,380 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:03,380 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,381 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,383 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:03,383 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,383 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:03,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:03,383 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:03,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:03,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:03,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:56:03,383 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:03,384 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:03,484 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:03,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:03,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:03,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:03,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,490 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:03,490 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:03,490 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:03,490 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:03,491 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,491 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,493 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,493 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:03,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:03,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:03,493 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:03,493 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:03,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:03,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,494 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,494 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:03,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:03,494 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:03,494 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:03,494 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:03,494 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:03,494 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:03,494 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:03,494 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:03,494 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:03,905 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030b678e2aec154511bab4b18093e432fe to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030b678e2aec154511bab4b18093e432fe 2023-02-11 00:56:04,310 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/6b342e133f9548ef98dccd5496c792f7 2023-02-11 00:56:04,314 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/6b342e133f9548ef98dccd5496c792f7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7 2023-02-11 00:56:04,317 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 00:56:04,318 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 824ms, sequenceid=33, compaction requested=true 2023-02-11 00:56:04,318 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:04,318 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,319 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41393c14[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:04,321 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:04,321 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,322 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:04,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,322 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:04,322 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:04,323 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:04,323 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:04,323 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:04,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:04,326 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:04,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:04,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:04,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,326 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:04,328 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,328 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:04,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,328 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:04,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:04,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:04,334 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,334 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:04,334 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:04,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:04,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:04,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:04,334 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:04,334 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:56:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:04,334 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:04,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:04,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,335 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,435 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:04,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:04,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:04,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:04,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,441 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:04,441 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:04,441 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:04,441 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:04,442 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,442 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,443 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:04,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:04,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:04,443 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:04,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:04,445 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:04,445 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:04,445 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:04,445 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:04,856 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907de87c238fe8141599300469fce6f1eb6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907de87c238fe8141599300469fce6f1eb6 2023-02-11 00:56:05,260 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/b24a9ba82fae4a22aa2a8366fbd8e669 2023-02-11 00:56:05,264 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/b24a9ba82fae4a22aa2a8366fbd8e669 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669 2023-02-11 00:56:05,267 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 00:56:05,267 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 822ms, sequenceid=37, compaction requested=true 2023-02-11 00:56:05,267 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:05,268 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:05,268 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:05,268 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:05,268 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,268 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:05,268 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,270 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:05,271 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,271 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c2dacd[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:05,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:05,272 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,273 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:05,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:05,273 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:05,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,273 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:05,274 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:05,275 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:05,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:05,277 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:05,277 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:05,277 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:05,277 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,277 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:05,278 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,278 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,278 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:05,279 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,280 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:05,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:05,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:05,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:05,283 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:05,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,283 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,284 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,284 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:05,284 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:05,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:05,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:05,284 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,284 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,384 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:05,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:05,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:05,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:05,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,389 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,390 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,391 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:05,391 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:05,391 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:05,391 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,392 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 00:56:05,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:05,392 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 00:56:05,392 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:05,392 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 00:56:05,393 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:05,393 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:05,393 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. started... 2023-02-11 00:56:05,393 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f3292ae7467f9fa52c707ab482543b5c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 00:56:05,804 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e0f0f78ce344462fbd37004807ea1020 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0f0f78ce344462fbd37004807ea1020 2023-02-11 00:56:06,209 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/c04aaa5c5ea440b4a41016a8b98d3596 2023-02-11 00:56:06,213 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/c04aaa5c5ea440b4a41016a8b98d3596 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596 2023-02-11 00:56:06,217 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 00:56:06,217 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3292ae7467f9fa52c707ab482543b5c in 824ms, sequenceid=41, compaction requested=true 2023-02-11 00:56:06,218 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:06,218 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 00:56:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 00:56:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 00:56:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 00:56:06,219 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,219 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:06,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:06,220 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,220 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:06,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 00:56:06,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29c15ee4[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:06,221 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 00:56:06,221 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,222 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,222 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 00:56:06,222 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,223 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:06,222 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 00:56:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 00:56:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:06,224 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,224 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 00:56:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:06,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 00:56:06,226 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 00:56:06,226 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:06,226 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:06,226 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,226 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:06,229 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,229 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,229 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:06,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:06,230 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,231 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,233 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 00:56:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 00:56:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:06,233 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:06,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:06,234 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:06,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:06,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:06,234 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:06,334 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:06,336 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-11 00:56:06,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:56:06,338 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:56:06,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:56:06,339 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077566339 2023-02-11 00:56:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 00:56:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 00:56:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:06,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x1d2259b2 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:56:06,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@383cb57b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:56:06,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:07,175 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103047cdbb434134d0ebddc0b83df34722b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103047cdbb434134d0ebddc0b83df34722b 2023-02-11 00:56:07,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:07,189 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:56:07,191 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:56:07,196 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:56:07,197 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:56:07,205 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4b80e215753b44238bafb0ae990ad562 first=Optional[r5] last=Optional[r6] 2023-02-11 00:56:07,206 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4b80e215753b44238bafb0ae990ad562}] 2023-02-11 00:56:07,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4b80e215753b44238bafb0ae990ad562 for inclusion in f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:07,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 00:56:07,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:56:07,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:07,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4b80e215753b44238bafb0ae990ad562 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fl8p5oln2uht94u1f3lpo0fvu1innec99oqt8mmgo4crk1v3tlkqpdpr34uehk8k/family1/4b80e215753b44238bafb0ae990ad562 2023-02-11 00:56:07,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fl8p5oln2uht94u1f3lpo0fvu1innec99oqt8mmgo4crk1v3tlkqpdpr34uehk8k/family1/4b80e215753b44238bafb0ae990ad562 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_ 2023-02-11 00:56:07,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fl8p5oln2uht94u1f3lpo0fvu1innec99oqt8mmgo4crk1v3tlkqpdpr34uehk8k/family1/4b80e215753b44238bafb0ae990ad562 into f3292ae7467f9fa52c707ab482543b5c/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_ - updating store file list. 2023-02-11 00:56:07,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_ into f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:07,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fl8p5oln2uht94u1f3lpo0fvu1innec99oqt8mmgo4crk1v3tlkqpdpr34uehk8k/family1/4b80e215753b44238bafb0ae990ad562 into f3292ae7467f9fa52c707ab482543b5c/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_) 2023-02-11 00:56:07,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fl8p5oln2uht94u1f3lpo0fvu1innec99oqt8mmgo4crk1v3tlkqpdpr34uehk8k/family1/4b80e215753b44238bafb0ae990ad562 2023-02-11 00:56:07,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 00:56:07,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 00:56:07,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): f3292ae7467f9fa52c707ab482543b5c/family1 is initiating minor compaction 2023-02-11 00:56:07,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f7c542; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:56:07,222 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f3292ae7467f9fa52c707ab482543b5c/family1 in testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:07,222 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp, totalSize=49.7 K 2023-02-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting d1883ec7e1d44c8db6ea1d51f234a6a6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting e9c6f631593c4a7383f08fea936f7982, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting fb418ec2570a4aa08c204def6396a5c6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting eadc24adcba2483a84995d5a8f979b8a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 00:56:07,222 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting a0ef67d1881a4c3288ba85f469858e2d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 00:56:07,223 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting ec4c8f6d9aa045769d92ee0a535b1daf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 00:56:07,223 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 6b342e133f9548ef98dccd5496c792f7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 00:56:07,223 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting b24a9ba82fae4a22aa2a8366fbd8e669, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 00:56:07,223 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting c04aaa5c5ea440b4a41016a8b98d3596, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 00:56:07,223 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting cf860b2d755749758cb48024ddbd344e_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 00:56:07,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:07,224 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:07,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010149c87679875843beb7b52cb7af3b7818 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010149c87679875843beb7b52cb7af3b7818 2023-02-11 00:56:07,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030b678e2aec154511bab4b18093e432fe to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030b678e2aec154511bab4b18093e432fe 2023-02-11 00:56:07,227 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 00:56:07,227 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 00:56:07,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:07,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:07,256 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): f3292ae7467f9fa52c707ab482543b5c#family1#compaction#165 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:56:07,673 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/14e6253dd7834ee3b41064f13c488fd9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/14e6253dd7834ee3b41064f13c488fd9 2023-02-11 00:56:07,678 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f3292ae7467f9fa52c707ab482543b5c/family1 of f3292ae7467f9fa52c707ab482543b5c into 14e6253dd7834ee3b41064f13c488fd9(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:07,678 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:07,678 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676076967222; duration=0sec 2023-02-11 00:56:07,678 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:56:07,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_] to archive 2023-02-11 00:56:07,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:07,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/d1883ec7e1d44c8db6ea1d51f234a6a6 2023-02-11 00:56:07,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e9c6f631593c4a7383f08fea936f7982 2023-02-11 00:56:07,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/fb418ec2570a4aa08c204def6396a5c6 2023-02-11 00:56:07,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/eadc24adcba2483a84995d5a8f979b8a 2023-02-11 00:56:07,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/a0ef67d1881a4c3288ba85f469858e2d 2023-02-11 00:56:07,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/ec4c8f6d9aa045769d92ee0a535b1daf 2023-02-11 00:56:07,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/6b342e133f9548ef98dccd5496c792f7 2023-02-11 00:56:07,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/b24a9ba82fae4a22aa2a8366fbd8e669 2023-02-11 00:56:07,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/c04aaa5c5ea440b4a41016a8b98d3596 2023-02-11 00:56:07,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/cf860b2d755749758cb48024ddbd344e_SeqId_44_ 2023-02-11 00:56:08,080 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231be707e4f97884e86a0b3196f17ece466 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231be707e4f97884e86a0b3196f17ece466 2023-02-11 00:56:08,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:08,105 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3270bc23e7354cebb3578692cc37ffc1 first=Optional[r1] last=Optional[r4] 2023-02-11 00:56:08,106 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3270bc23e7354cebb3578692cc37ffc1}] 2023-02-11 00:56:08,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3270bc23e7354cebb3578692cc37ffc1 for inclusion in f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:08,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 00:56:08,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:56:08,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:08,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3270bc23e7354cebb3578692cc37ffc1 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__31ksug4b98u6lutuu6k5f9sot2983fovm40ss7revaeq7hchq76sp7ued9cursj5/family1/3270bc23e7354cebb3578692cc37ffc1 2023-02-11 00:56:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__31ksug4b98u6lutuu6k5f9sot2983fovm40ss7revaeq7hchq76sp7ued9cursj5/family1/3270bc23e7354cebb3578692cc37ffc1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_ 2023-02-11 00:56:08,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__31ksug4b98u6lutuu6k5f9sot2983fovm40ss7revaeq7hchq76sp7ued9cursj5/family1/3270bc23e7354cebb3578692cc37ffc1 into f3292ae7467f9fa52c707ab482543b5c/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_ - updating store file list. 2023-02-11 00:56:08,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_ into f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:08,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__31ksug4b98u6lutuu6k5f9sot2983fovm40ss7revaeq7hchq76sp7ued9cursj5/family1/3270bc23e7354cebb3578692cc37ffc1 into f3292ae7467f9fa52c707ab482543b5c/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_) 2023-02-11 00:56:08,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__31ksug4b98u6lutuu6k5f9sot2983fovm40ss7revaeq7hchq76sp7ued9cursj5/family1/3270bc23e7354cebb3578692cc37ffc1 2023-02-11 00:56:08,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 00:56:08,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 00:56:08,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(1912): f3292ae7467f9fa52c707ab482543b5c/family1 is initiating minor compaction (all files) 2023-02-11 00:56:08,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@88be8d3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:56:08,119 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f3292ae7467f9fa52c707ab482543b5c/family1 in testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:08,119 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/14e6253dd7834ee3b41064f13c488fd9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp, totalSize=178.1 K 2023-02-11 00:56:08,120 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 8b95cfc2405c40b4a5ea66d12801accc, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837900 2023-02-11 00:56:08,120 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 14e6253dd7834ee3b41064f13c488fd9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237900 2023-02-11 00:56:08,120 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] compactions.Compactor(207): Compacting 2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237900 2023-02-11 00:56:08,121 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:08,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:08,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016840c6c54cea4eaf98f594eba757c6c3 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016840c6c54cea4eaf98f594eba757c6c3 2023-02-11 00:56:08,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120562497832eb3247379479be61a0f41b5f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120562497832eb3247379479be61a0f41b5f 2023-02-11 00:56:08,126 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286a2f0495b5f1401884a9405c34923d1f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512286a2f0495b5f1401884a9405c34923d1f 2023-02-11 00:56:08,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188355165428041ff946b8f5891f197a8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188355165428041ff946b8f5891f197a8 2023-02-11 00:56:08,127 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 00:56:08,127 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 00:56:08,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:08,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:08,149 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] throttle.PressureAwareThroughputController(145): f3292ae7467f9fa52c707ab482543b5c#family1#compaction#166 average throughput is 7.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-11 00:56:08,985 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c29fc3bb69544c999268ec418e665327 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c29fc3bb69544c999268ec418e665327 2023-02-11 00:56:08,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:08,991 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/.tmp/family1/e5145d3694df4cb8bc05f5ce52837b96 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/e5145d3694df4cb8bc05f5ce52837b96 2023-02-11 00:56:08,995 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f3292ae7467f9fa52c707ab482543b5c/family1 of f3292ae7467f9fa52c707ab482543b5c into e5145d3694df4cb8bc05f5ce52837b96(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:08,995 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:08,995 INFO [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676076968119; duration=0sec 2023-02-11 00:56:08,995 DEBUG [RS:0;jenkins-hbase4:43697-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 00:56:09,011 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4c703b68556f42fc9c8592411315f09b first=Optional[r00] last=Optional[r8] 2023-02-11 00:56:09,011 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4c703b68556f42fc9c8592411315f09b}] 2023-02-11 00:56:09,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4c703b68556f42fc9c8592411315f09b for inclusion in f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:09,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 00:56:09,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 00:56:09,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for f3292ae7467f9fa52c707ab482543b5c: 2023-02-11 00:56:09,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4c703b68556f42fc9c8592411315f09b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g9t09ckgdnqitqluhih8dnpfgul8gjd1atnlqml8dbfahftbr5lfm5b1uotiskds/family1/4c703b68556f42fc9c8592411315f09b 2023-02-11 00:56:09,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g9t09ckgdnqitqluhih8dnpfgul8gjd1atnlqml8dbfahftbr5lfm5b1uotiskds/family1/4c703b68556f42fc9c8592411315f09b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/5063f8b41bd54c1198293bd4f22b1ea8_SeqId_50_ 2023-02-11 00:56:09,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g9t09ckgdnqitqluhih8dnpfgul8gjd1atnlqml8dbfahftbr5lfm5b1uotiskds/family1/4c703b68556f42fc9c8592411315f09b into f3292ae7467f9fa52c707ab482543b5c/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/5063f8b41bd54c1198293bd4f22b1ea8_SeqId_50_ - updating store file list. 2023-02-11 00:56:09,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/5063f8b41bd54c1198293bd4f22b1ea8_SeqId_50_ into f3292ae7467f9fa52c707ab482543b5c/family1 2023-02-11 00:56:09,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g9t09ckgdnqitqluhih8dnpfgul8gjd1atnlqml8dbfahftbr5lfm5b1uotiskds/family1/4c703b68556f42fc9c8592411315f09b into f3292ae7467f9fa52c707ab482543b5c/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/5063f8b41bd54c1198293bd4f22b1ea8_SeqId_50_) 2023-02-11 00:56:09,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMinorCompactionWithMonthlyPolicy__g9t09ckgdnqitqluhih8dnpfgul8gjd1atnlqml8dbfahftbr5lfm5b1uotiskds/family1/4c703b68556f42fc9c8592411315f09b 2023-02-11 00:56:09,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:09,023 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:09,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0f0f78ce344462fbd37004807ea1020 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e0f0f78ce344462fbd37004807ea1020 2023-02-11 00:56:09,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2367b085cc949e899f068962e5f04ee to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2367b085cc949e899f068962e5f04ee 2023-02-11 00:56:09,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c2bddbd462ad4d4d994f3965af39dbeb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c2bddbd462ad4d4d994f3965af39dbeb 2023-02-11 00:56:09,027 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 00:56:09,027 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 00:56:09,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:09,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:09,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 00:56:09,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 00:56:09,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:56:09,030 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 00:56:09,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.6930 sec 2023-02-11 00:56:09,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/14e6253dd7834ee3b41064f13c488fd9, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_] to archive 2023-02-11 00:56:09,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:09,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/8b95cfc2405c40b4a5ea66d12801accc 2023-02-11 00:56:09,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/14e6253dd7834ee3b41064f13c488fd9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/14e6253dd7834ee3b41064f13c488fd9 2023-02-11 00:56:09,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_ to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/family1/2f49ed013c834cbfb313bfd8b8dcfe50_SeqId_47_ 2023-02-11 00:56:09,138 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254 (was 253) - Thread LEAK? -, OpenFileDescriptor=647 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=110 (was 104) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3233 (was 3287) 2023-02-11 00:56:09,151 INFO [Listener at localhost/36341] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=254, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=110, ProcessCount=168, AvailableMemoryMB=3232 2023-02-11 00:56:09,170 DEBUG [Listener at localhost/36341] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-11 00:56:09,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 00:56:09,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-11 00:56:09,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 00:56:09,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-11 00:56:09,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 00:56:09,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:09,228 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:09,228 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:09,228 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:09,228 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c empty. 2023-02-11 00:56:09,228 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748 empty. 2023-02-11 00:56:09,229 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8 empty. 2023-02-11 00:56:09,229 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:09,229 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:09,229 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:09,229 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-11 00:56:09,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:09,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:09,636 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-11 00:56:09,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5d64447c702814f1edcf615760dc67d8, NAME => 'testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:56:09,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 34473a4d2c02ec988bc4c68599e20748, NAME => 'testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:56:09,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 38d3b428c69354f2b25bf8dca5bcab3c, NAME => 'testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/.tmp 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 5d64447c702814f1edcf615760dc67d8, disabling compactions & flushes 2023-02-11 00:56:09,644 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. after waiting 0 ms 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:09,644 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:09,644 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 5d64447c702814f1edcf615760dc67d8: Waiting for close lock at 1676076969644Disabling compacts and flushes for region at 1676076969644Disabling writes for close at 1676076969644Writing region close event to WAL at 1676076969644Closed at 1676076969644 2023-02-11 00:56:09,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:10,045 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:10,045 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:10,045 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 38d3b428c69354f2b25bf8dca5bcab3c, disabling compactions & flushes 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 34473a4d2c02ec988bc4c68599e20748, disabling compactions & flushes 2023-02-11 00:56:10,046 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,046 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. after waiting 0 ms 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. after waiting 0 ms 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,046 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,046 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 34473a4d2c02ec988bc4c68599e20748: Waiting for close lock at 1676076970046Disabling compacts and flushes for region at 1676076970046Disabling writes for close at 1676076970046Writing region close event to WAL at 1676076970046Closed at 1676076970046 2023-02-11 00:56:10,046 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 38d3b428c69354f2b25bf8dca5bcab3c: Waiting for close lock at 1676076970045Disabling compacts and flushes for region at 1676076970045Disabling writes for close at 1676076970046 (+1 ms)Writing region close event to WAL at 1676076970046Closed at 1676076970046 2023-02-11 00:56:10,048 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 00:56:10,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076970049"}]},"ts":"1676076970049"} 2023-02-11 00:56:10,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676076970049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076970049"}]},"ts":"1676076970049"} 2023-02-11 00:56:10,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676076970049"}]},"ts":"1676076970049"} 2023-02-11 00:56:10,050 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 00:56:10,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 00:56:10,051 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076970051"}]},"ts":"1676076970051"} 2023-02-11 00:56:10,052 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-11 00:56:10,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d3b428c69354f2b25bf8dca5bcab3c, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=34473a4d2c02ec988bc4c68599e20748, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d64447c702814f1edcf615760dc67d8, ASSIGN}] 2023-02-11 00:56:10,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d3b428c69354f2b25bf8dca5bcab3c, ASSIGN 2023-02-11 00:56:10,057 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=34473a4d2c02ec988bc4c68599e20748, ASSIGN 2023-02-11 00:56:10,057 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d64447c702814f1edcf615760dc67d8, ASSIGN 2023-02-11 00:56:10,057 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d3b428c69354f2b25bf8dca5bcab3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:56:10,057 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d64447c702814f1edcf615760dc67d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:56:10,057 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=34473a4d2c02ec988bc4c68599e20748, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43697,1676076813915; forceNewPlan=false, retain=false 2023-02-11 00:56:10,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=5d64447c702814f1edcf615760dc67d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=38d3b428c69354f2b25bf8dca5bcab3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=34473a4d2c02ec988bc4c68599e20748, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076970209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076970209"}]},"ts":"1676076970209"} 2023-02-11 00:56:10,209 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076970209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076970209"}]},"ts":"1676076970209"} 2023-02-11 00:56:10,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676076970209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676076970209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676076970209"}]},"ts":"1676076970209"} 2023-02-11 00:56:10,210 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 38d3b428c69354f2b25bf8dca5bcab3c, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:56:10,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 34473a4d2c02ec988bc4c68599e20748, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:56:10,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 5d64447c702814f1edcf615760dc67d8, server=jenkins-hbase4.apache.org,43697,1676076813915}] 2023-02-11 00:56:10,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:10,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38d3b428c69354f2b25bf8dca5bcab3c, NAME => 'testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 00:56:10,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:10,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,387 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,388 DEBUG [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1 2023-02-11 00:56:10,388 DEBUG [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1 2023-02-11 00:56:10,389 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38d3b428c69354f2b25bf8dca5bcab3c columnFamilyName family1 2023-02-11 00:56:10,390 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] regionserver.HStore(310): Store=38d3b428c69354f2b25bf8dca5bcab3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,390 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,392 DEBUG [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2 2023-02-11 00:56:10,392 DEBUG [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2 2023-02-11 00:56:10,392 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38d3b428c69354f2b25bf8dca5bcab3c columnFamilyName family2 2023-02-11 00:56:10,393 INFO [StoreOpener-38d3b428c69354f2b25bf8dca5bcab3c-1] regionserver.HStore(310): Store=38d3b428c69354f2b25bf8dca5bcab3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:56:10,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:10,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:56:10,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 38d3b428c69354f2b25bf8dca5bcab3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73441970, jitterRate=0.09437063336372375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:56:10,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 38d3b428c69354f2b25bf8dca5bcab3c: Running coprocessor pre-open hook at 1676076970365Writing region info on filesystem at 1676076970365Initializing all the Stores at 1676076970366 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970366Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970366Cleaning up temporary data from old regions at 1676076970395 (+29 ms)Cleaning up detritus from prior splits at 1676076970395Running coprocessor post-open hooks at 1676076970399 (+4 ms)Region opened successfully at 1676076970399 2023-02-11 00:56:10,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c., pid=120, masterSystemTime=1676076970362 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:10,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34473a4d2c02ec988bc4c68599e20748, NAME => 'testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 00:56:10,401 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=38d3b428c69354f2b25bf8dca5bcab3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076970401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076970401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076970401"}]},"ts":"1676076970401"} 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-11 00:56:10,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 38d3b428c69354f2b25bf8dca5bcab3c, server=jenkins-hbase4.apache.org,43697,1676076813915 in 192 msec 2023-02-11 00:56:10,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d3b428c69354f2b25bf8dca5bcab3c, ASSIGN in 349 msec 2023-02-11 00:56:10,422 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,424 DEBUG [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1 2023-02-11 00:56:10,424 DEBUG [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1 2023-02-11 00:56:10,424 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34473a4d2c02ec988bc4c68599e20748 columnFamilyName family1 2023-02-11 00:56:10,425 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] regionserver.HStore(310): Store=34473a4d2c02ec988bc4c68599e20748/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,425 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,426 DEBUG [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2 2023-02-11 00:56:10,426 DEBUG [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2 2023-02-11 00:56:10,426 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34473a4d2c02ec988bc4c68599e20748 columnFamilyName family2 2023-02-11 00:56:10,427 INFO [StoreOpener-34473a4d2c02ec988bc4c68599e20748-1] regionserver.HStore(310): Store=34473a4d2c02ec988bc4c68599e20748/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:56:10,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:10,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:56:10,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34473a4d2c02ec988bc4c68599e20748; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71930351, jitterRate=0.07184575498104095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:56:10,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34473a4d2c02ec988bc4c68599e20748: Running coprocessor pre-open hook at 1676076970402Writing region info on filesystem at 1676076970402Initializing all the Stores at 1676076970402Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970402Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970402Cleaning up temporary data from old regions at 1676076970429 (+27 ms)Cleaning up detritus from prior splits at 1676076970429Running coprocessor post-open hooks at 1676076970433 (+4 ms)Region opened successfully at 1676076970433 2023-02-11 00:56:10,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748., pid=121, masterSystemTime=1676076970362 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:10,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d64447c702814f1edcf615760dc67d8, NAME => 'testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 00:56:10,435 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=34473a4d2c02ec988bc4c68599e20748, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,435 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676076970435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076970435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076970435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076970435"}]},"ts":"1676076970435"} 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-11 00:56:10,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 34473a4d2c02ec988bc4c68599e20748, server=jenkins-hbase4.apache.org,43697,1676076813915 in 225 msec 2023-02-11 00:56:10,439 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=34473a4d2c02ec988bc4c68599e20748, ASSIGN in 383 msec 2023-02-11 00:56:10,456 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,457 DEBUG [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1 2023-02-11 00:56:10,457 DEBUG [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1 2023-02-11 00:56:10,458 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d64447c702814f1edcf615760dc67d8 columnFamilyName family1 2023-02-11 00:56:10,458 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] regionserver.HStore(310): Store=5d64447c702814f1edcf615760dc67d8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,458 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,459 DEBUG [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2 2023-02-11 00:56:10,459 DEBUG [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2 2023-02-11 00:56:10,459 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d64447c702814f1edcf615760dc67d8 columnFamilyName family2 2023-02-11 00:56:10,460 INFO [StoreOpener-5d64447c702814f1edcf615760dc67d8-1] regionserver.HStore(310): Store=5d64447c702814f1edcf615760dc67d8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 00:56:10,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 00:56:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 00:56:10,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5d64447c702814f1edcf615760dc67d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64747085, jitterRate=-0.035193249583244324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 00:56:10,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5d64447c702814f1edcf615760dc67d8: Running coprocessor pre-open hook at 1676076970436Writing region info on filesystem at 1676076970436Initializing all the Stores at 1676076970436Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970436Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676076970436Cleaning up temporary data from old regions at 1676076970462 (+26 ms)Cleaning up detritus from prior splits at 1676076970462Running coprocessor post-open hooks at 1676076970465 (+3 ms)Region opened successfully at 1676076970465 2023-02-11 00:56:10,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8., pid=122, masterSystemTime=1676076970362 2023-02-11 00:56:10,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:10,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:10,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=5d64447c702814f1edcf615760dc67d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:10,468 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676076970467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676076970467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676076970467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676076970467"}]},"ts":"1676076970467"} 2023-02-11 00:56:10,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-11 00:56:10,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 5d64447c702814f1edcf615760dc67d8, server=jenkins-hbase4.apache.org,43697,1676076813915 in 257 msec 2023-02-11 00:56:10,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-11 00:56:10,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d64447c702814f1edcf615760dc67d8, ASSIGN in 415 msec 2023-02-11 00:56:10,471 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 00:56:10,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676076970471"}]},"ts":"1676076970471"} 2023-02-11 00:56:10,472 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-11 00:56:10,474 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 00:56:10,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2510 sec 2023-02-11 00:56:11,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 00:56:11,331 INFO [Listener at localhost/36341] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-11 00:56:11,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:11,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:11,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:11,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:11,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 00:56:11,340 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 00:56:11,341 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:11,341 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 00:56:11,341 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 00:56:11,341 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:11,341 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:11,342 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:11,342 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:11,343 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:11,343 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 00:56:11,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 00:56:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 00:56:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 00:56:11,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:11,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. started... 2023-02-11 00:56:11,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:11,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:56:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:11,345 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. started... 2023-02-11 00:56:11,345 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38d3b428c69354f2b25bf8dca5bcab3c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:56:11,344 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. started... 2023-02-11 00:56:11,345 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d64447c702814f1edcf615760dc67d8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:56:11,346 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34473a4d2c02ec988bc4c68599e20748 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 00:56:11,395 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211f8180eb3ec0a4123bb57b7408d7c4b77 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f8180eb3ec0a4123bb57b7408d7c4b77 2023-02-11 00:56:11,410 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/13d1d0c6838c416084b79c1f94e667a4 2023-02-11 00:56:11,790 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302119a3cb098fabc44c6a3c5f3154ebb819a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302119a3cb098fabc44c6a3c5f3154ebb819a 2023-02-11 00:56:11,790 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c7fc366c653d4809ba966d5c506c0ff4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7fc366c653d4809ba966d5c506c0ff4 2023-02-11 00:56:11,855 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-11 00:56:11,855 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211a40f46c6703249378224c931d64d4b92 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211a40f46c6703249378224c931d64d4b92 2023-02-11 00:56:12,205 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/0536a48411d84512a1be951bf1593bb5 2023-02-11 00:56:12,205 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/526a0a3b20944a1ebaf6f5c51866b6e4 2023-02-11 00:56:12,238 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211828edaca2edd4d2ca460df36864100bf to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211828edaca2edd4d2ca460df36864100bf 2023-02-11 00:56:12,242 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/78f61e7e99214f1b9bdfdd3228feb7e4 2023-02-11 00:56:12,245 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/0536a48411d84512a1be951bf1593bb5 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5 2023-02-11 00:56:12,263 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/5f840b31535547a9bf18351a2a4977b8 2023-02-11 00:56:12,267 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/13d1d0c6838c416084b79c1f94e667a4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4 2023-02-11 00:56:12,268 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 00:56:12,271 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/78f61e7e99214f1b9bdfdd3228feb7e4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4 2023-02-11 00:56:12,275 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:56:12,275 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 38d3b428c69354f2b25bf8dca5bcab3c in 930ms, sequenceid=5, compaction requested=false 2023-02-11 00:56:12,276 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:12,277 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:12,277 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:56:12,294 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 00:56:12,295 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/5f840b31535547a9bf18351a2a4977b8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8 2023-02-11 00:56:12,298 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:56:12,299 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5d64447c702814f1edcf615760dc67d8 in 954ms, sequenceid=5, compaction requested=false 2023-02-11 00:56:12,299 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:12,299 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:12,299 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:56:12,639 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021182c212cb3cee4dedbf5333aa1678d8c9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021182c212cb3cee4dedbf5333aa1678d8c9 2023-02-11 00:56:13,044 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/0a909f9f8c314180ae855e385e615fe2 2023-02-11 00:56:13,047 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/526a0a3b20944a1ebaf6f5c51866b6e4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4 2023-02-11 00:56:13,070 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 00:56:13,071 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/0a909f9f8c314180ae855e385e615fe2 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2 2023-02-11 00:56:13,074 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 00:56:13,074 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 34473a4d2c02ec988bc4c68599e20748 in 1728ms, sequenceid=5, compaction requested=false 2023-02-11 00:56:13,075 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:13,075 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:13,075 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:56:13,075 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:56:13,075 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,075 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 00:56:13,075 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 00:56:13,080 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,080 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:13,080 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,080 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:13,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 00:56:13,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6bf062[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:13,082 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 00:56:13,082 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,084 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,084 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 00:56:13,084 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 00:56:13,084 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:13,084 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,084 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:13,085 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,085 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 00:56:13,086 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:13,086 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:13,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 00:56:13,087 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 00:56:13,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:13,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:13,088 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 00:56:13,088 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:13,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:13,089 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,089 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:13,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,090 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:13,093 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:13,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 00:56:13,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 00:56:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:13,093 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:13,193 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:13,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:13,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:13,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:13,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:13,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:13,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:13,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 00:56:13,199 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 00:56:13,199 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:13,200 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 00:56:13,200 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 00:56:13,200 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,200 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:13,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,202 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:13,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:13,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:13,202 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:13,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:13,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:13,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:13,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 00:56:13,203 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 00:56:13,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 00:56:13,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 00:56:13,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:13,203 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. started... 2023-02-11 00:56:13,204 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:56:13,204 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:13,204 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38d3b428c69354f2b25bf8dca5bcab3c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. started... 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:13,204 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. started... 2023-02-11 00:56:13,204 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34473a4d2c02ec988bc4c68599e20748 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:56:13,204 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d64447c702814f1edcf615760dc67d8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 00:56:13,247 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113a09130adb5a403489ab038313f1c159 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302113a09130adb5a403489ab038313f1c159 2023-02-11 00:56:13,247 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211b60321833ebc426c9ac5801066189e05 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211b60321833ebc426c9ac5801066189e05 2023-02-11 00:56:13,646 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302113cfecffa56914947a9128030aedb1d2d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cfecffa56914947a9128030aedb1d2d 2023-02-11 00:56:13,661 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/7929b74f4d514a54b086a52f19ba8e9d 2023-02-11 00:56:13,667 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/5d4f9c0d3463446598a725c05d18bb70 2023-02-11 00:56:13,696 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211e5d596244067402eb963b142cedaffee to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211e5d596244067402eb963b142cedaffee 2023-02-11 00:56:14,061 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/977d2547c2464861a466dbfd3b51ddea 2023-02-11 00:56:14,092 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211de645d1f160748f99d11d09ebf1f4892 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211de645d1f160748f99d11d09ebf1f4892 2023-02-11 00:56:14,100 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/a3c9b7d24e524870a1c1e0e269035c06 2023-02-11 00:56:14,103 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/5d4f9c0d3463446598a725c05d18bb70 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70 2023-02-11 00:56:14,126 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 00:56:14,127 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/a3c9b7d24e524870a1c1e0e269035c06 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06 2023-02-11 00:56:14,130 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:56:14,131 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 38d3b428c69354f2b25bf8dca5bcab3c in 927ms, sequenceid=9, compaction requested=false 2023-02-11 00:56:14,131 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:14,131 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:14,131 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:56:14,493 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211caf696f516d245a1b3ad3e989ecd7734 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211caf696f516d245a1b3ad3e989ecd7734 2023-02-11 00:56:14,496 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/7d916148659f4c53a6508baf7ca401cc 2023-02-11 00:56:14,500 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/7929b74f4d514a54b086a52f19ba8e9d as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d 2023-02-11 00:56:14,523 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 00:56:14,523 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/7d916148659f4c53a6508baf7ca401cc as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc 2023-02-11 00:56:14,527 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:56:14,527 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 34473a4d2c02ec988bc4c68599e20748 in 1323ms, sequenceid=9, compaction requested=false 2023-02-11 00:56:14,527 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:14,527 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:14,527 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:56:14,898 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/c60283e0485c426fb478d6686a658a66 2023-02-11 00:56:14,902 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/977d2547c2464861a466dbfd3b51ddea as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea 2023-02-11 00:56:14,924 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 00:56:14,926 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/c60283e0485c426fb478d6686a658a66 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66 2023-02-11 00:56:14,929 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 00:56:14,930 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5d64447c702814f1edcf615760dc67d8 in 1726ms, sequenceid=9, compaction requested=false 2023-02-11 00:56:14,930 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:14,930 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 00:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 00:56:14,931 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,931 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 00:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53aa447[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:14,933 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 00:56:14,933 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,934 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 00:56:14,934 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,934 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 00:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:14,935 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,935 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:14,936 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:14,936 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:14,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 00:56:14,938 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 00:56:14,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:14,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:14,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 00:56:14,938 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:14,945 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,945 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:14,945 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:14,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:14,945 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,947 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,948 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,948 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:14,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:14,949 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:14,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 00:56:14,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:14,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:14,949 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:15,049 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:15,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:15,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:15,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:15,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:15,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:15,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:15,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 00:56:15,055 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 00:56:15,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:15,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 00:56:15,055 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 00:56:15,056 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:15,056 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:15,057 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:15,057 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:15,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:15,057 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:15,057 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:15,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:15,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 00:56:15,058 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 00:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 00:56:15,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 00:56:15,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:15,058 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. started... 2023-02-11 00:56:15,059 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:56:15,059 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38d3b428c69354f2b25bf8dca5bcab3c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:56:15,059 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. started... 2023-02-11 00:56:15,059 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. started... 2023-02-11 00:56:15,059 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d64447c702814f1edcf615760dc67d8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:56:15,059 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34473a4d2c02ec988bc4c68599e20748 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 00:56:15,107 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b91ecd5a93c54c678d516d1f52103fef to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b91ecd5a93c54c678d516d1f52103fef 2023-02-11 00:56:15,122 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/611f83154dc240c2bf59245fd927ed29 2023-02-11 00:56:15,162 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211eece8b36a137455a94365ef702856b6b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211eece8b36a137455a94365ef702856b6b 2023-02-11 00:56:15,168 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b 2023-02-11 00:56:15,171 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/611f83154dc240c2bf59245fd927ed29 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29 2023-02-11 00:56:15,194 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 00:56:15,195 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b 2023-02-11 00:56:15,198 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:56:15,199 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5d64447c702814f1edcf615760dc67d8 in 140ms, sequenceid=13, compaction requested=true 2023-02-11 00:56:15,199 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:15,199 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:15,199 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:56:15,504 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211dcb59b182891434685f02359bfcaee58 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211dcb59b182891434685f02359bfcaee58 2023-02-11 00:56:15,504 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f3ab78fbdcc14971afc5d467d680c9ab to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f3ab78fbdcc14971afc5d467d680c9ab 2023-02-11 00:56:15,904 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 00:56:15,926 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/13070b781b7845d9ba5473f31eefeec0 2023-02-11 00:56:15,926 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/f8c6fabce35c46709bf443ebe6660389 2023-02-11 00:56:16,361 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302115a08498d878a4c2dbb5122d894039b63 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302115a08498d878a4c2dbb5122d894039b63 2023-02-11 00:56:16,369 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302119bb1afe3f9a449f4a954881f781d487e to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302119bb1afe3f9a449f4a954881f781d487e 2023-02-11 00:56:16,766 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/7c2540c2a23147e48f5c3355e55a7c02 2023-02-11 00:56:16,769 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/13070b781b7845d9ba5473f31eefeec0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0 2023-02-11 00:56:16,774 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/e846751c49384151bdeb26ba6cde7e33 2023-02-11 00:56:16,777 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/f8c6fabce35c46709bf443ebe6660389 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389 2023-02-11 00:56:16,800 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 00:56:16,800 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/7c2540c2a23147e48f5c3355e55a7c02 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02 2023-02-11 00:56:16,804 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:56:16,805 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 38d3b428c69354f2b25bf8dca5bcab3c in 1746ms, sequenceid=13, compaction requested=true 2023-02-11 00:56:16,805 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:16,805 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:16,805 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:56:16,806 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 00:56:16,806 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/e846751c49384151bdeb26ba6cde7e33 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33 2023-02-11 00:56:16,810 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 00:56:16,811 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 34473a4d2c02ec988bc4c68599e20748 in 1752ms, sequenceid=13, compaction requested=true 2023-02-11 00:56:16,811 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:16,811 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 00:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 00:56:16,812 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:16,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,813 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:16,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 00:56:16,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@319a029f[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:16,814 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 00:56:16,814 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,817 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 00:56:16,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 00:56:16,817 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:16,817 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,817 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 00:56:16,818 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 00:56:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:16,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:16,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:16,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 00:56:16,820 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 00:56:16,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:16,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:16,820 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 00:56:16,820 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:16,821 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:16,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:16,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:16,822 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,823 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:16,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:16,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:16,825 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:16,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:16,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 00:56:16,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:16,825 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:16,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:16,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:16,826 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:16,926 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:16,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:16,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:16,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:16,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 00:56:16,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:16,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:16,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 00:56:16,932 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 00:56:16,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:16,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 00:56:16,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 00:56:16,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,932 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:16,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,938 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:16,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:16,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:16,938 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:16,938 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 00:56:16,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 00:56:16,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 00:56:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 00:56:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 00:56:16,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:16,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. started... 2023-02-11 00:56:16,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:16,939 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. started... 2023-02-11 00:56:16,939 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38d3b428c69354f2b25bf8dca5bcab3c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:56:16,939 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34473a4d2c02ec988bc4c68599e20748 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:56:16,939 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:56:16,940 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:16,940 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:16,940 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. started... 2023-02-11 00:56:16,940 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d64447c702814f1edcf615760dc67d8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 00:56:16,983 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302117c24a8a67adb4f46a0aa3669f64e40a2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302117c24a8a67adb4f46a0aa3669f64e40a2 2023-02-11 00:56:17,386 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211313521126623487397bb66e6f779df60 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211313521126623487397bb66e6f779df60 2023-02-11 00:56:17,388 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211efdef5f1143b483591355d60101b5974 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211efdef5f1143b483591355d60101b5974 2023-02-11 00:56:17,398 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/45701076669e4be4af88ff6ac4a151d5 2023-02-11 00:56:17,406 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/f642b816c7ac4096b9ffc8e0ef29ad60 2023-02-11 00:56:17,412 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/e9db4f2ca754462e8494d5da0745faa5 2023-02-11 00:56:17,453 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021110dd3da8be004c40a886409fd5f48d61 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021110dd3da8be004c40a886409fd5f48d61 2023-02-11 00:56:17,468 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23 2023-02-11 00:56:17,472 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/45701076669e4be4af88ff6ac4a151d5 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5 2023-02-11 00:56:17,508 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 00:56:17,509 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23 2023-02-11 00:56:17,513 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:56:17,513 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 38d3b428c69354f2b25bf8dca5bcab3c in 574ms, sequenceid=17, compaction requested=true 2023-02-11 00:56:17,514 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:17,514 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:56:17,866 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302110d97c6a3487743babe160f5a4168eeca to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302110d97c6a3487743babe160f5a4168eeca 2023-02-11 00:56:17,879 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302113c65ae48c258433a94df959033175693 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302113c65ae48c258433a94df959033175693 2023-02-11 00:56:18,271 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/3f1b4ef6554241769099e8c066a788df 2023-02-11 00:56:18,276 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/f642b816c7ac4096b9ffc8e0ef29ad60 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60 2023-02-11 00:56:18,284 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/5dd0047fff61435cab365828d41c1cae 2023-02-11 00:56:18,288 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/e9db4f2ca754462e8494d5da0745faa5 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5 2023-02-11 00:56:18,310 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 00:56:18,311 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/5dd0047fff61435cab365828d41c1cae as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae 2023-02-11 00:56:18,311 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 00:56:18,312 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/3f1b4ef6554241769099e8c066a788df as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df 2023-02-11 00:56:18,314 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:56:18,315 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 34473a4d2c02ec988bc4c68599e20748 in 1376ms, sequenceid=17, compaction requested=true 2023-02-11 00:56:18,315 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:18,315 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:18,315 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:56:18,316 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 00:56:18,316 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5d64447c702814f1edcf615760dc67d8 in 1376ms, sequenceid=17, compaction requested=true 2023-02-11 00:56:18,316 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:18,317 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:56:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:56:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 00:56:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 00:56:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,318 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:18,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 00:56:18,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@120f5c36[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:18,320 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 00:56:18,320 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,320 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,321 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 00:56:18,321 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 00:56:18,321 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,321 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:18,321 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:18,323 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:18,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 00:56:18,325 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 00:56:18,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:18,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:18,326 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 00:56:18,326 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:18,327 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:18,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:18,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:18,327 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,329 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:18,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,330 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,330 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:18,330 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:18,330 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:18,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:18,330 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:18,330 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:18,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 00:56:18,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:18,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:18,331 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:18,431 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:18,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:18,440 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:18,446 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:18,454 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:18,455 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:18,539 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 00:56:18,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 00:56:18,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 00:56:18,541 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 00:56:18,541 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:18,541 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 00:56:18,541 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 00:56:18,541 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,541 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:18,542 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:18,542 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:18,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:18,543 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:18,543 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 00:56:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:18,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 00:56:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:18,543 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 00:56:18,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 00:56:18,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 00:56:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 00:56:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 00:56:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. started... 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:18,544 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38d3b428c69354f2b25bf8dca5bcab3c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:56:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. started... 2023-02-11 00:56:18,544 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. started... 2023-02-11 00:56:18,545 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d64447c702814f1edcf615760dc67d8 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:56:18,545 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34473a4d2c02ec988bc4c68599e20748 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 00:56:18,584 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/d3d57b31f7424464b23dd0e92d7f70c5 2023-02-11 00:56:18,607 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3d57b31f7424464b23dd0e92d7f70c5 2023-02-11 00:56:18,989 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/fe4c9d73646249399d41d4962ecdccdd 2023-02-11 00:56:19,021 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe4c9d73646249399d41d4962ecdccdd 2023-02-11 00:56:19,023 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/2cdbb460df714ad2adf329d4f1d68761 2023-02-11 00:56:19,026 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cdbb460df714ad2adf329d4f1d68761 2023-02-11 00:56:19,026 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/d3d57b31f7424464b23dd0e92d7f70c5 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5 2023-02-11 00:56:19,050 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3d57b31f7424464b23dd0e92d7f70c5 2023-02-11 00:56:19,050 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 00:56:19,051 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/2cdbb460df714ad2adf329d4f1d68761 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761 2023-02-11 00:56:19,054 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cdbb460df714ad2adf329d4f1d68761 2023-02-11 00:56:19,054 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:56:19,055 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 34473a4d2c02ec988bc4c68599e20748 in 510ms, sequenceid=23, compaction requested=true 2023-02-11 00:56:19,055 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:19,055 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:19,055 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 00:56:19,388 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/531d8aa8bb894724abfd7c6d945568c7 2023-02-11 00:56:19,429 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:56:19,429 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6efb9ce3 to 127.0.0.1:63942 2023-02-11 00:56:19,429 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:19,430 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:56:19,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d2259b2 to 127.0.0.1:63942 2023-02-11 00:56:19,430 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:19,432 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/9867de1a51dc46b6a2ca00281fdf965f 2023-02-11 00:56:19,436 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9867de1a51dc46b6a2ca00281fdf965f 2023-02-11 00:56:19,436 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/fe4c9d73646249399d41d4962ecdccdd as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd 2023-02-11 00:56:19,445 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 531d8aa8bb894724abfd7c6d945568c7 2023-02-11 00:56:19,460 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe4c9d73646249399d41d4962ecdccdd 2023-02-11 00:56:19,460 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 00:56:19,460 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/9867de1a51dc46b6a2ca00281fdf965f as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f 2023-02-11 00:56:19,463 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9867de1a51dc46b6a2ca00281fdf965f 2023-02-11 00:56:19,464 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:56:19,464 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 38d3b428c69354f2b25bf8dca5bcab3c in 920ms, sequenceid=23, compaction requested=true 2023-02-11 00:56:19,464 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:19,464 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:19,464 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 00:56:20,257 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/0463dbb63f594c56b72909b1b45745cb 2023-02-11 00:56:20,260 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0463dbb63f594c56b72909b1b45745cb 2023-02-11 00:56:20,261 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/531d8aa8bb894724abfd7c6d945568c7 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7 2023-02-11 00:56:20,284 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 531d8aa8bb894724abfd7c6d945568c7 2023-02-11 00:56:20,285 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 00:56:20,285 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/0463dbb63f594c56b72909b1b45745cb as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb 2023-02-11 00:56:20,289 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0463dbb63f594c56b72909b1b45745cb 2023-02-11 00:56:20,290 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 00:56:20,290 INFO [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5d64447c702814f1edcf615760dc67d8 in 1745ms, sequenceid=23, compaction requested=true 2023-02-11 00:56:20,291 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:20,291 DEBUG [rs(jenkins-hbase4.apache.org,43697,1676076813915)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:20,291 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 00:56:20,291 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 00:56:20,291 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,291 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 00:56:20,291 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 00:56:20,292 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 00:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43697,1676076813915' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 00:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@403556f5[Count = 0] remaining members to acquire global barrier 2023-02-11 00:56:20,294 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 00:56:20,294 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,295 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,296 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 00:56:20,296 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 00:56:20,296 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,296 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 00:56:20,296 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43697,1676076813915' in zk 2023-02-11 00:56:20,298 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 00:56:20,298 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:20,298 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,298 DEBUG [member: 'jenkins-hbase4.apache.org,43697,1676076813915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 00:56:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43697,1676076813915': 2023-02-11 00:56:20,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43697,1676076813915' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 00:56:20,300 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 00:56:20,301 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 00:56:20,301 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 00:56:20,301 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 00:56:20,301 INFO [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 00:56:20,302 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,302 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 00:56:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 00:56:20,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,302 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 00:56:20,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:20,303 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 00:56:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,304 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 00:56:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 00:56:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:20,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 00:56:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 00:56:20,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 00:56:20,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 00:56:20,306 DEBUG [(jenkins-hbase4.apache.org,33799,1676076812795)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 00:56:20,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 00:56:20,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 00:56:20,306 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 00:56:20,307 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 00:56:20,407 DEBUG [Listener at localhost/36341] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 00:56:20,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33799] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 00:56:20,408 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:20,408 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 38d3b428c69354f2b25bf8dca5bcab3c/family1 is initiating major compaction (all files) 2023-02-11 00:56:20,408 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:20,409 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:20,409 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 38d3b428c69354f2b25bf8dca5bcab3c/family1 in testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:20,409 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp, totalSize=27.1 K 2023-02-11 00:56:20,410 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0536a48411d84512a1be951bf1593bb5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:20,410 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 5d4f9c0d3463446598a725c05d18bb70, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973195 2023-02-11 00:56:20,410 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 13070b781b7845d9ba5473f31eefeec0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975051 2023-02-11 00:56:20,411 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 45701076669e4be4af88ff6ac4a151d5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:20,411 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting fe4c9d73646249399d41d4962ecdccdd, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:20,422 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 38d3b428c69354f2b25bf8dca5bcab3c#family1#compaction#197 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:20,471 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del 2023-02-11 00:56:20,472 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del 2023-02-11 00:56:20,535 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0f5b5aa626a486ab9efbbdb7ca8f021 2023-02-11 00:56:20,536 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family1/d0f5b5aa626a486ab9efbbdb7ca8f021 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/d0f5b5aa626a486ab9efbbdb7ca8f021 2023-02-11 00:56:20,558 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0f5b5aa626a486ab9efbbdb7ca8f021 2023-02-11 00:56:20,559 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38d3b428c69354f2b25bf8dca5bcab3c/family1 of 38d3b428c69354f2b25bf8dca5bcab3c into d0f5b5aa626a486ab9efbbdb7ca8f021(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:20,559 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:20,559 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:20,559 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 38d3b428c69354f2b25bf8dca5bcab3c/family2 is initiating major compaction (all files) 2023-02-11 00:56:20,559 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:20,560 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:20,560 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 38d3b428c69354f2b25bf8dca5bcab3c/family2 in testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:20,560 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp, totalSize=25.4 K 2023-02-11 00:56:20,560 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 78f61e7e99214f1b9bdfdd3228feb7e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:20,561 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting a3c9b7d24e524870a1c1e0e269035c06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973195 2023-02-11 00:56:20,561 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7c2540c2a23147e48f5c3355e55a7c02, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975051 2023-02-11 00:56:20,561 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting f5678d5fd3d74c388a6f9ec2fd7ceb23, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:20,562 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 9867de1a51dc46b6a2ca00281fdf965f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:20,570 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 38d3b428c69354f2b25bf8dca5bcab3c#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:20,580 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211f808a665a8d745a8b224c007ffff9959_del 2023-02-11 00:56:20,580 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f808a665a8d745a8b224c007ffff9959_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211f808a665a8d745a8b224c007ffff9959_del 2023-02-11 00:56:20,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd] to archive 2023-02-11 00:56:20,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:20,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/0536a48411d84512a1be951bf1593bb5 2023-02-11 00:56:20,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5d4f9c0d3463446598a725c05d18bb70 2023-02-11 00:56:20,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/13070b781b7845d9ba5473f31eefeec0 2023-02-11 00:56:20,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/45701076669e4be4af88ff6ac4a151d5 2023-02-11 00:56:20,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/fe4c9d73646249399d41d4962ecdccdd 2023-02-11 00:56:21,396 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e7506fb185c4933b48035c8a07a8ef9 2023-02-11 00:56:21,396 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/.tmp/family2/5e7506fb185c4933b48035c8a07a8ef9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/5e7506fb185c4933b48035c8a07a8ef9 2023-02-11 00:56:21,400 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e7506fb185c4933b48035c8a07a8ef9 2023-02-11 00:56:21,401 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38d3b428c69354f2b25bf8dca5bcab3c/family2 of 38d3b428c69354f2b25bf8dca5bcab3c into 5e7506fb185c4933b48035c8a07a8ef9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:21,401 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:21,401 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:21,401 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 34473a4d2c02ec988bc4c68599e20748/family1 is initiating major compaction (all files) 2023-02-11 00:56:21,401 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:21,402 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:21,404 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 34473a4d2c02ec988bc4c68599e20748/family1 in testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:21,404 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp, totalSize=27.1 K 2023-02-11 00:56:21,404 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 526a0a3b20944a1ebaf6f5c51866b6e4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:21,405 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7929b74f4d514a54b086a52f19ba8e9d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973195 2023-02-11 00:56:21,405 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting f8c6fabce35c46709bf443ebe6660389, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975051 2023-02-11 00:56:21,405 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting e9db4f2ca754462e8494d5da0745faa5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:21,406 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting d3d57b31f7424464b23dd0e92d7f70c5, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:21,414 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 34473a4d2c02ec988bc4c68599e20748#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:21,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f] to archive 2023-02-11 00:56:21,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:21,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/78f61e7e99214f1b9bdfdd3228feb7e4 2023-02-11 00:56:21,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/a3c9b7d24e524870a1c1e0e269035c06 2023-02-11 00:56:21,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/7c2540c2a23147e48f5c3355e55a7c02 2023-02-11 00:56:21,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/f5678d5fd3d74c388a6f9ec2fd7ceb23 2023-02-11 00:56:21,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family2/9867de1a51dc46b6a2ca00281fdf965f 2023-02-11 00:56:21,855 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del 2023-02-11 00:56:21,855 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del 2023-02-11 00:56:22,708 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ac5eef8da5f4b29ad6f1af1a659539a 2023-02-11 00:56:22,709 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family1/7ac5eef8da5f4b29ad6f1af1a659539a as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7ac5eef8da5f4b29ad6f1af1a659539a 2023-02-11 00:56:22,731 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ac5eef8da5f4b29ad6f1af1a659539a 2023-02-11 00:56:22,732 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 34473a4d2c02ec988bc4c68599e20748/family1 of 34473a4d2c02ec988bc4c68599e20748 into 7ac5eef8da5f4b29ad6f1af1a659539a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:56:22,732 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:22,732 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:22,732 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 34473a4d2c02ec988bc4c68599e20748/family2 is initiating major compaction (all files) 2023-02-11 00:56:22,732 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:22,732 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:22,732 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 34473a4d2c02ec988bc4c68599e20748/family2 in testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:22,732 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp, totalSize=25.4 K 2023-02-11 00:56:22,733 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0a909f9f8c314180ae855e385e615fe2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:22,733 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 7d916148659f4c53a6508baf7ca401cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973195 2023-02-11 00:56:22,733 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting e846751c49384151bdeb26ba6cde7e33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975051 2023-02-11 00:56:22,734 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 5dd0047fff61435cab365828d41c1cae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:22,734 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 2cdbb460df714ad2adf329d4f1d68761, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:22,741 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 34473a4d2c02ec988bc4c68599e20748#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:22,747 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021123d694bd622043018503f221e6b67b8e_del 2023-02-11 00:56:22,747 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021123d694bd622043018503f221e6b67b8e_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021123d694bd622043018503f221e6b67b8e_del 2023-02-11 00:56:22,757 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbde199d23a343268853eca5836f2da4 2023-02-11 00:56:22,758 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/.tmp/family2/cbde199d23a343268853eca5836f2da4 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/cbde199d23a343268853eca5836f2da4 2023-02-11 00:56:22,761 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbde199d23a343268853eca5836f2da4 2023-02-11 00:56:22,762 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 34473a4d2c02ec988bc4c68599e20748/family2 of 34473a4d2c02ec988bc4c68599e20748 into cbde199d23a343268853eca5836f2da4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:22,762 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:22,762 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:22,762 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 5d64447c702814f1edcf615760dc67d8/family1 is initiating major compaction (all files) 2023-02-11 00:56:22,762 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:22,762 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:22,762 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 5d64447c702814f1edcf615760dc67d8/family1 in testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:22,762 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp, totalSize=27.1 K 2023-02-11 00:56:22,763 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 13d1d0c6838c416084b79c1f94e667a4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:22,763 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 977d2547c2464861a466dbfd3b51ddea, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973196 2023-02-11 00:56:22,763 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 611f83154dc240c2bf59245fd927ed29, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975052 2023-02-11 00:56:22,764 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting f642b816c7ac4096b9ffc8e0ef29ad60, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:22,764 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 531d8aa8bb894724abfd7c6d945568c7, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:22,771 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 5d64447c702814f1edcf615760dc67d8#family1#compaction#201 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:22,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5] to archive 2023-02-11 00:56:22,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:22,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/526a0a3b20944a1ebaf6f5c51866b6e4 2023-02-11 00:56:22,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/7929b74f4d514a54b086a52f19ba8e9d 2023-02-11 00:56:22,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/f8c6fabce35c46709bf443ebe6660389 2023-02-11 00:56:22,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/e9db4f2ca754462e8494d5da0745faa5 2023-02-11 00:56:22,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/d3d57b31f7424464b23dd0e92d7f70c5 2023-02-11 00:56:22,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761] to archive 2023-02-11 00:56:22,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:22,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/0a909f9f8c314180ae855e385e615fe2 2023-02-11 00:56:22,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/7d916148659f4c53a6508baf7ca401cc 2023-02-11 00:56:22,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/e846751c49384151bdeb26ba6cde7e33 2023-02-11 00:56:22,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/5dd0047fff61435cab365828d41c1cae 2023-02-11 00:56:22,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family2/2cdbb460df714ad2adf329d4f1d68761 2023-02-11 00:56:23,221 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del 2023-02-11 00:56:23,222 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del 2023-02-11 00:56:24,076 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00437f7e09024cb3881df4133d923c6e 2023-02-11 00:56:24,077 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family1/00437f7e09024cb3881df4133d923c6e as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/00437f7e09024cb3881df4133d923c6e 2023-02-11 00:56:24,100 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00437f7e09024cb3881df4133d923c6e 2023-02-11 00:56:24,101 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d64447c702814f1edcf615760dc67d8/family1 of 5d64447c702814f1edcf615760dc67d8 into 00437f7e09024cb3881df4133d923c6e(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 00:56:24,101 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:24,102 DEBUG [Listener at localhost/36341] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 00:56:24,102 DEBUG [Listener at localhost/36341] regionserver.HStore(1912): 5d64447c702814f1edcf615760dc67d8/family2 is initiating major compaction (all files) 2023-02-11 00:56:24,102 INFO [Listener at localhost/36341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 00:56:24,102 INFO [Listener at localhost/36341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 00:56:24,103 INFO [Listener at localhost/36341] regionserver.HRegion(2258): Starting compaction of 5d64447c702814f1edcf615760dc67d8/family2 in testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:24,103 INFO [Listener at localhost/36341] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb] into tmpdir=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp, totalSize=25.4 K 2023-02-11 00:56:24,103 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 5f840b31535547a9bf18351a2a4977b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676076971337 2023-02-11 00:56:24,104 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting c60283e0485c426fb478d6686a658a66, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676076973196 2023-02-11 00:56:24,104 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 900f37a2ae1f4d3da9ddfdb5a20e0e4b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676076975052 2023-02-11 00:56:24,104 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 3f1b4ef6554241769099e8c066a788df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676076976928 2023-02-11 00:56:24,105 DEBUG [Listener at localhost/36341] compactions.Compactor(207): Compacting 0463dbb63f594c56b72909b1b45745cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 00:56:24,112 INFO [Listener at localhost/36341] throttle.PressureAwareThroughputController(145): 5d64447c702814f1edcf615760dc67d8#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 00:56:24,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7] to archive 2023-02-11 00:56:24,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:24,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/13d1d0c6838c416084b79c1f94e667a4 2023-02-11 00:56:24,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/977d2547c2464861a466dbfd3b51ddea 2023-02-11 00:56:24,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/611f83154dc240c2bf59245fd927ed29 2023-02-11 00:56:24,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/f642b816c7ac4096b9ffc8e0ef29ad60 2023-02-11 00:56:24,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/531d8aa8bb894724abfd7c6d945568c7 2023-02-11 00:56:24,519 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302113ab95837b9aa4d73b9b5407d714b138b_del 2023-02-11 00:56:24,520 INFO [Listener at localhost/36341] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302113ab95837b9aa4d73b9b5407d714b138b_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302113ab95837b9aa4d73b9b5407d714b138b_del 2023-02-11 00:56:24,931 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efd4b5d6f08e478da8df415fd047aa29 2023-02-11 00:56:24,931 DEBUG [Listener at localhost/36341] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/.tmp/family2/efd4b5d6f08e478da8df415fd047aa29 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/efd4b5d6f08e478da8df415fd047aa29 2023-02-11 00:56:24,935 INFO [Listener at localhost/36341] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efd4b5d6f08e478da8df415fd047aa29 2023-02-11 00:56:24,936 INFO [Listener at localhost/36341] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d64447c702814f1edcf615760dc67d8/family2 of 5d64447c702814f1edcf615760dc67d8 into efd4b5d6f08e478da8df415fd047aa29(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 00:56:24,936 DEBUG [Listener at localhost/36341] regionserver.HRegion(2288): Compaction status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:24,939 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:24,942 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:24,945 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:24,946 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:24,950 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33799] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xC2\xB4&c\xF2`yl\x0DA\x8Ex\xF1\x82\xBE"\x10\xF4n$\x99sS\x98\x00\xEB\xF4\xC7\xB7?\x00\xF2\xE1*\x10\xA6;\xA1\x0C\xE3\xB3\xC8)'M\x049\xEF\xC4nG2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-11 00:56:24,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 00:56:24,973 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 00:56:24,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:56:24,973 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676077584973 2023-02-11 00:56:24,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 00:56:24,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb] to archive 2023-02-11 00:56:24,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:24,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/5f840b31535547a9bf18351a2a4977b8 2023-02-11 00:56:24,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/c60283e0485c426fb478d6686a658a66 2023-02-11 00:56:24,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/900f37a2ae1f4d3da9ddfdb5a20e0e4b 2023-02-11 00:56:24,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/3f1b4ef6554241769099e8c066a788df 2023-02-11 00:56:24,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family2/0463dbb63f594c56b72909b1b45745cb 2023-02-11 00:56:25,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-11 00:56:25,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del 2023-02-11 00:56:25,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del 2023-02-11 00:56:25,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del 2023-02-11 00:56:25,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:25,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] zookeeper.ReadOnlyZKClient(139): Connect 0x128ac748 to 127.0.0.1:63942 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 00:56:25,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27462aa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 00:56:25,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:25,543 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021174025597e98a4765914ebed4695a6120 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021174025597e98a4765914ebed4695a6120 2023-02-11 00:56:25,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:25,560 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 00:56:25,563 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 00:56:25,572 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 00:56:25,574 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 00:56:25,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/501b0efb1baa46c187c21b526060dbb0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 00:56:25,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/501b0efb1baa46c187c21b526060dbb0}] 2023-02-11 00:56:25,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/501b0efb1baa46c187c21b526060dbb0 for inclusion in 34473a4d2c02ec988bc4c68599e20748/family1 2023-02-11 00:56:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 00:56:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 00:56:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 34473a4d2c02ec988bc4c68599e20748: 2023-02-11 00:56:25,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/501b0efb1baa46c187c21b526060dbb0 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__mhbu24uffg8eu50bkea8nkr2l82p1ugb34b4dbnloa0tghu59a6r2deifl2vmk8q/family1/501b0efb1baa46c187c21b526060dbb0 2023-02-11 00:56:25,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__mhbu24uffg8eu50bkea8nkr2l82p1ugb34b4dbnloa0tghu59a6r2deifl2vmk8q/family1/501b0efb1baa46c187c21b526060dbb0 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/13a08673e2a44257b5e1b7ce637d4779_SeqId_28_ 2023-02-11 00:56:25,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__mhbu24uffg8eu50bkea8nkr2l82p1ugb34b4dbnloa0tghu59a6r2deifl2vmk8q/family1/501b0efb1baa46c187c21b526060dbb0 into 34473a4d2c02ec988bc4c68599e20748/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/13a08673e2a44257b5e1b7ce637d4779_SeqId_28_ - updating store file list. 2023-02-11 00:56:25,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/13a08673e2a44257b5e1b7ce637d4779_SeqId_28_ into 34473a4d2c02ec988bc4c68599e20748/family1 2023-02-11 00:56:25,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__mhbu24uffg8eu50bkea8nkr2l82p1ugb34b4dbnloa0tghu59a6r2deifl2vmk8q/family1/501b0efb1baa46c187c21b526060dbb0 into 34473a4d2c02ec988bc4c68599e20748/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/family1/13a08673e2a44257b5e1b7ce637d4779_SeqId_28_) 2023-02-11 00:56:25,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__mhbu24uffg8eu50bkea8nkr2l82p1ugb34b4dbnloa0tghu59a6r2deifl2vmk8q/family1/501b0efb1baa46c187c21b526060dbb0 2023-02-11 00:56:25,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:25,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:25,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302119a3cb098fabc44c6a3c5f3154ebb819a to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302119a3cb098fabc44c6a3c5f3154ebb819a 2023-02-11 00:56:25,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211b60321833ebc426c9ac5801066189e05 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211b60321833ebc426c9ac5801066189e05 2023-02-11 00:56:25,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211efdef5f1143b483591355d60101b5974 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211efdef5f1143b483591355d60101b5974 2023-02-11 00:56:25,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f3ab78fbdcc14971afc5d467d680c9ab to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f3ab78fbdcc14971afc5d467d680c9ab 2023-02-11 00:56:25,675 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 00:56:25,675 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 00:56:25,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:25,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:26,218 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302112173006000cf48a8ae5af7940cb41ada to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302112173006000cf48a8ae5af7940cb41ada 2023-02-11 00:56:26,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:26,257 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e6d1e8325fde4a13bef49057fb294ce8 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 00:56:26,258 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e6d1e8325fde4a13bef49057fb294ce8}] 2023-02-11 00:56:26,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e6d1e8325fde4a13bef49057fb294ce8 for inclusion in 5d64447c702814f1edcf615760dc67d8/family1 2023-02-11 00:56:26,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 00:56:26,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 00:56:26,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 5d64447c702814f1edcf615760dc67d8: 2023-02-11 00:56:26,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/e6d1e8325fde4a13bef49057fb294ce8 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__p04fvjfv1rjul35cq5frekr5c0s3vorf90i38j05coculsctn3facrr8qn4k44ok/family1/e6d1e8325fde4a13bef49057fb294ce8 2023-02-11 00:56:26,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__p04fvjfv1rjul35cq5frekr5c0s3vorf90i38j05coculsctn3facrr8qn4k44ok/family1/e6d1e8325fde4a13bef49057fb294ce8 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/45ca509c278e4b78aed726b6ea5e9f51_SeqId_28_ 2023-02-11 00:56:26,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__p04fvjfv1rjul35cq5frekr5c0s3vorf90i38j05coculsctn3facrr8qn4k44ok/family1/e6d1e8325fde4a13bef49057fb294ce8 into 5d64447c702814f1edcf615760dc67d8/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/45ca509c278e4b78aed726b6ea5e9f51_SeqId_28_ - updating store file list. 2023-02-11 00:56:26,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/45ca509c278e4b78aed726b6ea5e9f51_SeqId_28_ into 5d64447c702814f1edcf615760dc67d8/family1 2023-02-11 00:56:26,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__p04fvjfv1rjul35cq5frekr5c0s3vorf90i38j05coculsctn3facrr8qn4k44ok/family1/e6d1e8325fde4a13bef49057fb294ce8 into 5d64447c702814f1edcf615760dc67d8/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/family1/45ca509c278e4b78aed726b6ea5e9f51_SeqId_28_) 2023-02-11 00:56:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__p04fvjfv1rjul35cq5frekr5c0s3vorf90i38j05coculsctn3facrr8qn4k44ok/family1/e6d1e8325fde4a13bef49057fb294ce8 2023-02-11 00:56:26,314 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:26,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:26,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211313521126623487397bb66e6f779df60 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211313521126623487397bb66e6f779df60 2023-02-11 00:56:26,317 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cfecffa56914947a9128030aedb1d2d to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302113cfecffa56914947a9128030aedb1d2d 2023-02-11 00:56:26,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b91ecd5a93c54c678d516d1f52103fef to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b91ecd5a93c54c678d516d1f52103fef 2023-02-11 00:56:26,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f8180eb3ec0a4123bb57b7408d7c4b77 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211f8180eb3ec0a4123bb57b7408d7c4b77 2023-02-11 00:56:26,321 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 00:56:26,321 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 00:56:26,322 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:26,322 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:26,500 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211363404956c924282bda53e32ddfef0c9 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211363404956c924282bda53e32ddfef0c9 2023-02-11 00:56:26,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:26,545 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/73e4d62ddddc4e069fdc7613241cf622 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 00:56:26,546 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c., hostname=jenkins-hbase4.apache.org,43697,1676076813915, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/73e4d62ddddc4e069fdc7613241cf622}] 2023-02-11 00:56:26,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(763): Validating hfile at hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/73e4d62ddddc4e069fdc7613241cf622 for inclusion in 38d3b428c69354f2b25bf8dca5bcab3c/family1 2023-02-11 00:56:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 00:56:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 00:56:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegion(2445): Flush status journal for 38d3b428c69354f2b25bf8dca5bcab3c: 2023-02-11 00:56:26,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/73e4d62ddddc4e069fdc7613241cf622 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__fjtmg53oibn6dbcpjnnpomcp6ldbd4aplqng6qf6u4tovcrj86ll072b9sqg06g/family1/73e4d62ddddc4e069fdc7613241cf622 2023-02-11 00:56:26,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__fjtmg53oibn6dbcpjnnpomcp6ldbd4aplqng6qf6u4tovcrj86ll072b9sqg06g/family1/73e4d62ddddc4e069fdc7613241cf622 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5dc46f3d59a24b2388ae30fce23868ec_SeqId_28_ 2023-02-11 00:56:26,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(849): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__fjtmg53oibn6dbcpjnnpomcp6ldbd4aplqng6qf6u4tovcrj86ll072b9sqg06g/family1/73e4d62ddddc4e069fdc7613241cf622 into 38d3b428c69354f2b25bf8dca5bcab3c/family1 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5dc46f3d59a24b2388ae30fce23868ec_SeqId_28_ - updating store file list. 2023-02-11 00:56:26,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(882): Loaded HFile hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5dc46f3d59a24b2388ae30fce23868ec_SeqId_28_ into 38d3b428c69354f2b25bf8dca5bcab3c/family1 2023-02-11 00:56:26,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.HStore(855): Successfully loaded hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__fjtmg53oibn6dbcpjnnpomcp6ldbd4aplqng6qf6u4tovcrj86ll072b9sqg06g/family1/73e4d62ddddc4e069fdc7613241cf622 into 38d3b428c69354f2b25bf8dca5bcab3c/family1 (new location: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/family1/5dc46f3d59a24b2388ae30fce23868ec_SeqId_28_) 2023-02-11 00:56:26,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43697] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/staging/jenkins__testMajorCompactionFromAdmin__fjtmg53oibn6dbcpjnnpomcp6ldbd4aplqng6qf6u4tovcrj86ll072b9sqg06g/family1/73e4d62ddddc4e069fdc7613241cf622 2023-02-11 00:56:26,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:26,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:26,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302113a09130adb5a403489ab038313f1c159 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302113a09130adb5a403489ab038313f1c159 2023-02-11 00:56:26,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302117c24a8a67adb4f46a0aa3669f64e40a2 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302117c24a8a67adb4f46a0aa3669f64e40a2 2023-02-11 00:56:26,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7fc366c653d4809ba966d5c506c0ff4 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211c7fc366c653d4809ba966d5c506c0ff4 2023-02-11 00:56:26,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211dcb59b182891434685f02359bfcaee58 to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211dcb59b182891434685f02359bfcaee58 2023-02-11 00:56:26,599 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 00:56:26,599 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 00:56:26,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:26,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 00:56:26,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 00:56:26,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del] 2023-02-11 00:56:26,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:26,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302111d45968aee184b8c88489db2c9966332_del 2023-02-11 00:56:26,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 00:56:26,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del] 2023-02-11 00:56:26,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:26,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211c1820c41242a48738a7eff57d820f3a1_del 2023-02-11 00:56:26,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 00:56:26,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del] 2023-02-11 00:56:26,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 00:56:26,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del to hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302114600b3380f1641f6a08890d6de7b3ad2_del 2023-02-11 00:56:26,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 00:56:26,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676076817825] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 00:56:26,606 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 00:56:26,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 1.6340 sec 2023-02-11 00:56:26,619 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:26,622 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:26,624 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 00:56:26,625 DEBUG [Listener at localhost/36341] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 00:56:26,629 INFO [Listener at localhost/36341] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 00:56:26,663 INFO [Listener at localhost/36341] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 254), OpenFileDescriptor=643 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=108 (was 110), ProcessCount=168 (was 168), AvailableMemoryMB=3204 (was 3232) 2023-02-11 00:56:26,663 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06140021 to 127.0.0.1:63942 2023-02-11 00:56:26,664 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:26,664 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 00:56:26,664 INFO [Listener at localhost/36341] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 00:56:26,664 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6decc8b7 to 127.0.0.1:63942 2023-02-11 00:56:26,664 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:26,664 DEBUG [Listener at localhost/36341] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 00:56:26,664 DEBUG [Listener at localhost/36341] util.JVMClusterUtil(257): Found active master hash=2130346226, stopped=false 2023-02-11 00:56:26,664 INFO [Listener at localhost/36341] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:56:26,666 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 00:56:26,666 INFO [Listener at localhost/36341] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 00:56:26,666 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 00:56:26,666 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:56:26,666 DEBUG [Listener at localhost/36341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32ba0f0f to 127.0.0.1:63942 2023-02-11 00:56:26,666 DEBUG [Listener at localhost/36341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:26,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 00:56:26,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 00:56:26,666 INFO [Listener at localhost/36341] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43697,1676076813915' ***** 2023-02-11 00:56:26,667 INFO [Listener at localhost/36341] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 00:56:26,667 INFO [RS:0;jenkins-hbase4:43697] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 00:56:26,667 INFO [RS:0;jenkins-hbase4:43697] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 00:56:26,667 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 00:56:26,667 INFO [RS:0;jenkins-hbase4:43697] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 00:56:26,667 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for b43278b0748bb249ee9de5ea2a2e7a01 2023-02-11 00:56:26,668 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 533d184e0a7efe24165b6d1bd587d20e 2023-02-11 00:56:26,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b43278b0748bb249ee9de5ea2a2e7a01, disabling compactions & flushes 2023-02-11 00:56:26,668 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 2ae39e54d1127650946f335a6cc7dd55 2023-02-11 00:56:26,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:56:26,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:56:26,668 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 042a93d7715004fb92e348c1e093dcfc 2023-02-11 00:56:26,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. after waiting 0 ms 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 023ae0c28a4f9953fdcf7c55b19f9acd 2023-02-11 00:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 38d3b428c69354f2b25bf8dca5bcab3c 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 80edaca03d31c7d428645cb0f1ae4381 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 34473a4d2c02ec988bc4c68599e20748 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 4651ccd3f867fdf14b96e97db6fc4f5f 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 8345c4509858289d889b35025a217950 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for d42d4a3686689b68f0a67d076f2a5669 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 0d12514b202d3cc96021e2315962764c 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 150784ae1670fd37287c48625f800672 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 0841ab8ecf7db94fc27d1a2ecb0c90b3 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 897ed1e72710a942b6f8cdb46e38cc74 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 8e4998376fc5760496e5e507b5b5e79d 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 4700892eb348df5c2d48ad6d6e217a96 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for cc1065bd3f43e44e7e6d2a0b5c404d8f 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 5d64447c702814f1edcf615760dc67d8 2023-02-11 00:56:26,669 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:26,669 DEBUG [RS:0;jenkins-hbase4:43697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78bad09c to 127.0.0.1:63942 2023-02-11 00:56:26,669 DEBUG [RS:0;jenkins-hbase4:43697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:26,670 INFO [RS:0;jenkins-hbase4:43697] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 00:56:26,670 INFO [RS:0;jenkins-hbase4:43697] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 00:56:26,670 INFO [RS:0;jenkins-hbase4:43697] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 00:56:26,670 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 00:56:26,670 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-11 00:56:26,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 00:56:26,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 00:56:26,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 00:56:26,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 00:56:26,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 00:56:26,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-11 00:56:26,671 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 023ae0c28a4f9953fdcf7c55b19f9acd, 042a93d7715004fb92e348c1e093dcfc, 0841ab8ecf7db94fc27d1a2ecb0c90b3, 0d12514b202d3cc96021e2315962764c, 150784ae1670fd37287c48625f800672, 1588230740, 2ae39e54d1127650946f335a6cc7dd55, 34473a4d2c02ec988bc4c68599e20748, 38d3b428c69354f2b25bf8dca5bcab3c, 4651ccd3f867fdf14b96e97db6fc4f5f, 4700892eb348df5c2d48ad6d6e217a96, 533d184e0a7efe24165b6d1bd587d20e, 5d64447c702814f1edcf615760dc67d8, 80edaca03d31c7d428645cb0f1ae4381, 8345c4509858289d889b35025a217950, 897ed1e72710a942b6f8cdb46e38cc74, 8e4998376fc5760496e5e507b5b5e79d, b43278b0748bb249ee9de5ea2a2e7a01, cc1065bd3f43e44e7e6d2a0b5c404d8f, d42d4a3686689b68f0a67d076f2a5669, f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:56:26,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/b43278b0748bb249ee9de5ea2a2e7a01/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 00:56:26,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b43278b0748bb249ee9de5ea2a2e7a01: Waiting for close lock at 1676076986668Running coprocessor pre-close hooks at 1676076986668Disabling compacts and flushes for region at 1676076986668Disabling writes for close at 1676076986669 (+1 ms)Writing region close event to WAL at 1676076986670 (+1 ms)Running coprocessor post-close hooks at 1676076986673 (+3 ms)Closed at 1676076986674 (+1 ms) 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676076910563.b43278b0748bb249ee9de5ea2a2e7a01. 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 533d184e0a7efe24165b6d1bd587d20e, disabling compactions & flushes 2023-02-11 00:56:26,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. after waiting 0 ms 2023-02-11 00:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:56:26,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithMonthlyPolicy/533d184e0a7efe24165b6d1bd587d20e/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-02-11 00:56:26,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 533d184e0a7efe24165b6d1bd587d20e: Waiting for close lock at 1676076986674Running coprocessor pre-close hooks at 1676076986674Disabling compacts and flushes for region at 1676076986674Disabling writes for close at 1676076986674Writing region close event to WAL at 1676076986674Running coprocessor post-close hooks at 1676076986677 (+3 ms)Closed at 1676076986678 (+1 ms) 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676076831433.533d184e0a7efe24165b6d1bd587d20e. 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2ae39e54d1127650946f335a6cc7dd55, disabling compactions & flushes 2023-02-11 00:56:26,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. after waiting 0 ms 2023-02-11 00:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:56:26,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/2ae39e54d1127650946f335a6cc7dd55/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 00:56:26,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:56:26,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2ae39e54d1127650946f335a6cc7dd55: Waiting for close lock at 1676076986678Running coprocessor pre-close hooks at 1676076986678Disabling compacts and flushes for region at 1676076986678Disabling writes for close at 1676076986678Writing region close event to WAL at 1676076986679 (+1 ms)Running coprocessor post-close hooks at 1676076986681 (+2 ms)Closed at 1676076986681 2023-02-11 00:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676076852911.2ae39e54d1127650946f335a6cc7dd55. 2023-02-11 00:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 042a93d7715004fb92e348c1e093dcfc, disabling compactions & flushes 2023-02-11 00:56:26,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. after waiting 0 ms 2023-02-11 00:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:56:26,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyPolicy/042a93d7715004fb92e348c1e093dcfc/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 00:56:26,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 042a93d7715004fb92e348c1e093dcfc: Waiting for close lock at 1676076986682Running coprocessor pre-close hooks at 1676076986682Disabling compacts and flushes for region at 1676076986682Disabling writes for close at 1676076986682Writing region close event to WAL at 1676076986682Running coprocessor post-close hooks at 1676076986684 (+2 ms)Closed at 1676076986685 (+1 ms) 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676076857950.042a93d7715004fb92e348c1e093dcfc. 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 023ae0c28a4f9953fdcf7c55b19f9acd, disabling compactions & flushes 2023-02-11 00:56:26,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. after waiting 0 ms 2023-02-11 00:56:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/023ae0c28a4f9953fdcf7c55b19f9acd/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 00:56:26,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:56:26,688 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-11 00:56:26,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 023ae0c28a4f9953fdcf7c55b19f9acd: Waiting for close lock at 1676076986685Running coprocessor pre-close hooks at 1676076986685Disabling compacts and flushes for region at 1676076986685Disabling writes for close at 1676076986685Writing region close event to WAL at 1676076986686 (+1 ms)Running coprocessor post-close hooks at 1676076986688 (+2 ms)Closed at 1676076986688 2023-02-11 00:56:26,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676076910563.023ae0c28a4f9953fdcf7c55b19f9acd. 2023-02-11 00:56:26,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 38d3b428c69354f2b25bf8dca5bcab3c, disabling compactions & flushes 2023-02-11 00:56:26,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:26,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:26,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. after waiting 0 ms 2023-02-11 00:56:26,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/38d3b428c69354f2b25bf8dca5bcab3c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:26,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 38d3b428c69354f2b25bf8dca5bcab3c: Waiting for close lock at 1676076986688Running coprocessor pre-close hooks at 1676076986688Disabling compacts and flushes for region at 1676076986688Disabling writes for close at 1676076986689 (+1 ms)Writing region close event to WAL at 1676076986689Running coprocessor post-close hooks at 1676076986692 (+3 ms)Closed at 1676076986692 2023-02-11 00:56:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676076969193.38d3b428c69354f2b25bf8dca5bcab3c. 2023-02-11 00:56:26,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 80edaca03d31c7d428645cb0f1ae4381, disabling compactions & flushes 2023-02-11 00:56:26,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:56:26,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:56:26,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. after waiting 0 ms 2023-02-11 00:56:26,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:56:26,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/80edaca03d31c7d428645cb0f1ae4381/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:26,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 80edaca03d31c7d428645cb0f1ae4381: Waiting for close lock at 1676076986692Running coprocessor pre-close hooks at 1676076986692Disabling compacts and flushes for region at 1676076986692Disabling writes for close at 1676076986693 (+1 ms)Writing region close event to WAL at 1676076986693Running coprocessor post-close hooks at 1676076986696 (+3 ms)Closed at 1676076986696 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676076937091.80edaca03d31c7d428645cb0f1ae4381. 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34473a4d2c02ec988bc4c68599e20748, disabling compactions & flushes 2023-02-11 00:56:26,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. after waiting 0 ms 2023-02-11 00:56:26,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:26,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/34473a4d2c02ec988bc4c68599e20748/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:26,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34473a4d2c02ec988bc4c68599e20748: Waiting for close lock at 1676076986696Running coprocessor pre-close hooks at 1676076986696Disabling compacts and flushes for region at 1676076986696Disabling writes for close at 1676076986696Writing region close event to WAL at 1676076986697 (+1 ms)Running coprocessor post-close hooks at 1676076986699 (+2 ms)Closed at 1676076986700 (+1 ms) 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676076969193.34473a4d2c02ec988bc4c68599e20748. 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4651ccd3f867fdf14b96e97db6fc4f5f, disabling compactions & flushes 2023-02-11 00:56:26,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. after waiting 0 ms 2023-02-11 00:56:26,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:56:26,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4651ccd3f867fdf14b96e97db6fc4f5f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 00:56:26,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4651ccd3f867fdf14b96e97db6fc4f5f: Waiting for close lock at 1676076986700Running coprocessor pre-close hooks at 1676076986700Disabling compacts and flushes for region at 1676076986700Disabling writes for close at 1676076986700Writing region close event to WAL at 1676076986701 (+1 ms)Running coprocessor post-close hooks at 1676076986703 (+2 ms)Closed at 1676076986703 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676076870860.4651ccd3f867fdf14b96e97db6fc4f5f. 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8345c4509858289d889b35025a217950, disabling compactions & flushes 2023-02-11 00:56:26,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. after waiting 0 ms 2023-02-11 00:56:26,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:56:26,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8345c4509858289d889b35025a217950 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-11 00:56:26,753 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 00:56:26,871 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 0841ab8ecf7db94fc27d1a2ecb0c90b3, 0d12514b202d3cc96021e2315962764c, 150784ae1670fd37287c48625f800672, 1588230740, 4700892eb348df5c2d48ad6d6e217a96, 5d64447c702814f1edcf615760dc67d8, 8345c4509858289d889b35025a217950, 897ed1e72710a942b6f8cdb46e38cc74, 8e4998376fc5760496e5e507b5b5e79d, cc1065bd3f43e44e7e6d2a0b5c404d8f, d42d4a3686689b68f0a67d076f2a5669, f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:56:26,874 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 00:56:26,874 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 00:56:27,072 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 0841ab8ecf7db94fc27d1a2ecb0c90b3, 0d12514b202d3cc96021e2315962764c, 150784ae1670fd37287c48625f800672, 1588230740, 4700892eb348df5c2d48ad6d6e217a96, 5d64447c702814f1edcf615760dc67d8, 8345c4509858289d889b35025a217950, 897ed1e72710a942b6f8cdb46e38cc74, 8e4998376fc5760496e5e507b5b5e79d, cc1065bd3f43e44e7e6d2a0b5c404d8f, d42d4a3686689b68f0a67d076f2a5669, f3292ae7467f9fa52c707ab482543b5c 2023-02-11 00:56:27,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/info/6aff39f1f75c406fba0627caa270ea07 2023-02-11 00:56:27,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6aff39f1f75c406fba0627caa270ea07 2023-02-11 00:56:27,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/.tmp/info/6f869619e00842dca18b3371bb58faf9 2023-02-11 00:56:27,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/.tmp/info/6f869619e00842dca18b3371bb58faf9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/info/6f869619e00842dca18b3371bb58faf9 2023-02-11 00:56:27,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/info/6f869619e00842dca18b3371bb58faf9, entries=3, sequenceid=7, filesize=4.8 K 2023-02-11 00:56:27,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 8345c4509858289d889b35025a217950 in 414ms, sequenceid=7, compaction requested=false 2023-02-11 00:56:27,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/namespace/8345c4509858289d889b35025a217950/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-11 00:56:27,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8345c4509858289d889b35025a217950: Waiting for close lock at 1676076986703Running coprocessor pre-close hooks at 1676076986703Disabling compacts and flushes for region at 1676076986703Disabling writes for close at 1676076986703Obtaining lock to block concurrent updates at 1676076986703Preparing flush snapshotting stores in 8345c4509858289d889b35025a217950 at 1676076986703Finished memstore snapshotting hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676076986703Flushing stores of hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. at 1676076986704 (+1 ms)Flushing 8345c4509858289d889b35025a217950/info: creating writer at 1676076986704Flushing 8345c4509858289d889b35025a217950/info: appending metadata at 1676076986705 (+1 ms)Flushing 8345c4509858289d889b35025a217950/info: closing flushed file at 1676076986705Flushing 8345c4509858289d889b35025a217950/info: reopening flushed file at 1676076987113 (+408 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 8345c4509858289d889b35025a217950 in 414ms, sequenceid=7, compaction requested=false at 1676076987117 (+4 ms)Writing region close event to WAL at 1676076987119 (+2 ms)Running coprocessor post-close hooks at 1676076987121 (+2 ms)Closed at 1676076987122 (+1 ms) 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676076817210.8345c4509858289d889b35025a217950. 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d42d4a3686689b68f0a67d076f2a5669, disabling compactions & flushes 2023-02-11 00:56:27,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. after waiting 0 ms 2023-02-11 00:56:27,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:56:27,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/d42d4a3686689b68f0a67d076f2a5669/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 00:56:27,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d42d4a3686689b68f0a67d076f2a5669: Waiting for close lock at 1676076987122Running coprocessor pre-close hooks at 1676076987122Disabling compacts and flushes for region at 1676076987122Disabling writes for close at 1676076987122Writing region close event to WAL at 1676076987122Running coprocessor post-close hooks at 1676076987125 (+3 ms)Closed at 1676076987125 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676076852911.d42d4a3686689b68f0a67d076f2a5669. 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d12514b202d3cc96021e2315962764c, disabling compactions & flushes 2023-02-11 00:56:27,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. after waiting 0 ms 2023-02-11 00:56:27,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:56:27,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/0d12514b202d3cc96021e2315962764c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:27,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d12514b202d3cc96021e2315962764c: Waiting for close lock at 1676076987125Running coprocessor pre-close hooks at 1676076987125Disabling compacts and flushes for region at 1676076987125Disabling writes for close at 1676076987125Writing region close event to WAL at 1676076987126 (+1 ms)Running coprocessor post-close hooks at 1676076987128 (+2 ms)Closed at 1676076987129 (+1 ms) 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676076937091.0d12514b202d3cc96021e2315962764c. 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 150784ae1670fd37287c48625f800672, disabling compactions & flushes 2023-02-11 00:56:27,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. after waiting 0 ms 2023-02-11 00:56:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:56:27,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testScannerOnBulkLoadRefHFiles/150784ae1670fd37287c48625f800672/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 00:56:27,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 150784ae1670fd37287c48625f800672: Waiting for close lock at 1676076987129Running coprocessor pre-close hooks at 1676076987129Disabling compacts and flushes for region at 1676076987129Disabling writes for close at 1676076987129Writing region close event to WAL at 1676076987129Running coprocessor post-close hooks at 1676076987131 (+2 ms)Closed at 1676076987132 (+1 ms) 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676076852911.150784ae1670fd37287c48625f800672. 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0841ab8ecf7db94fc27d1a2ecb0c90b3, disabling compactions & flushes 2023-02-11 00:56:27,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. after waiting 0 ms 2023-02-11 00:56:27,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:56:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithWeeklyPolicy/0841ab8ecf7db94fc27d1a2ecb0c90b3/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 00:56:27,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:56:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0841ab8ecf7db94fc27d1a2ecb0c90b3: Waiting for close lock at 1676076987133Running coprocessor pre-close hooks at 1676076987133Disabling compacts and flushes for region at 1676076987133Disabling writes for close at 1676076987133Writing region close event to WAL at 1676076987133Running coprocessor post-close hooks at 1676076987135 (+2 ms)Closed at 1676076987135 2023-02-11 00:56:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676076841207.0841ab8ecf7db94fc27d1a2ecb0c90b3. 2023-02-11 00:56:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 897ed1e72710a942b6f8cdb46e38cc74, disabling compactions & flushes 2023-02-11 00:56:27,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:56:27,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:56:27,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. after waiting 0 ms 2023-02-11 00:56:27,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:56:27,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/ns/testMinorCompaction/897ed1e72710a942b6f8cdb46e38cc74/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:27,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:56:27,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 897ed1e72710a942b6f8cdb46e38cc74: Waiting for close lock at 1676076987135Running coprocessor pre-close hooks at 1676076987135Disabling compacts and flushes for region at 1676076987135Disabling writes for close at 1676076987136 (+1 ms)Writing region close event to WAL at 1676076987136Running coprocessor post-close hooks at 1676076987138 (+2 ms)Closed at 1676076987138 2023-02-11 00:56:27,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676076937091.897ed1e72710a942b6f8cdb46e38cc74. 2023-02-11 00:56:27,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e4998376fc5760496e5e507b5b5e79d, disabling compactions & flushes 2023-02-11 00:56:27,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:56:27,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:56:27,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. after waiting 0 ms 2023-02-11 00:56:27,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8e4998376fc5760496e5e507b5b5e79d/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 00:56:27,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e4998376fc5760496e5e507b5b5e79d: Waiting for close lock at 1676076987139Running coprocessor pre-close hooks at 1676076987139Disabling compacts and flushes for region at 1676076987139Disabling writes for close at 1676076987139Writing region close event to WAL at 1676076987139Running coprocessor post-close hooks at 1676076987141 (+2 ms)Closed at 1676076987141 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676076887468.8e4998376fc5760496e5e507b5b5e79d. 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4700892eb348df5c2d48ad6d6e217a96, disabling compactions & flushes 2023-02-11 00:56:27,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. after waiting 0 ms 2023-02-11 00:56:27,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/4700892eb348df5c2d48ad6d6e217a96/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 00:56:27,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4700892eb348df5c2d48ad6d6e217a96: Waiting for close lock at 1676076987141Running coprocessor pre-close hooks at 1676076987141Disabling compacts and flushes for region at 1676076987141Disabling writes for close at 1676076987141Writing region close event to WAL at 1676076987142 (+1 ms)Running coprocessor post-close hooks at 1676076987144 (+2 ms)Closed at 1676076987144 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676076817941.4700892eb348df5c2d48ad6d6e217a96. 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cc1065bd3f43e44e7e6d2a0b5c404d8f, disabling compactions & flushes 2023-02-11 00:56:27,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. after waiting 0 ms 2023-02-11 00:56:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:56:27,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testCompactionWithHFileLink/cc1065bd3f43e44e7e6d2a0b5c404d8f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 00:56:27,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cc1065bd3f43e44e7e6d2a0b5c404d8f: Waiting for close lock at 1676076987144Running coprocessor pre-close hooks at 1676076987144Disabling compacts and flushes for region at 1676076987144Disabling writes for close at 1676076987144Writing region close event to WAL at 1676076987145 (+1 ms)Running coprocessor post-close hooks at 1676076987148 (+3 ms)Closed at 1676076987148 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676076910563.cc1065bd3f43e44e7e6d2a0b5c404d8f. 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f3292ae7467f9fa52c707ab482543b5c, disabling compactions & flushes 2023-02-11 00:56:27,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. after waiting 0 ms 2023-02-11 00:56:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMinorCompactionWithMonthlyPolicy/f3292ae7467f9fa52c707ab482543b5c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-11 00:56:27,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f3292ae7467f9fa52c707ab482543b5c: Waiting for close lock at 1676076987148Running coprocessor pre-close hooks at 1676076987148Disabling compacts and flushes for region at 1676076987148Disabling writes for close at 1676076987148Writing region close event to WAL at 1676076987149 (+1 ms)Running coprocessor post-close hooks at 1676076987151 (+2 ms)Closed at 1676076987151 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676076955892.f3292ae7467f9fa52c707ab482543b5c. 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5d64447c702814f1edcf615760dc67d8, disabling compactions & flushes 2023-02-11 00:56:27,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. after waiting 0 ms 2023-02-11 00:56:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:27,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/default/testMajorCompactionFromAdmin/5d64447c702814f1edcf615760dc67d8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 00:56:27,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:27,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5d64447c702814f1edcf615760dc67d8: Waiting for close lock at 1676076987151Running coprocessor pre-close hooks at 1676076987151Disabling compacts and flushes for region at 1676076987151Disabling writes for close at 1676076987151Writing region close event to WAL at 1676076987152 (+1 ms)Running coprocessor post-close hooks at 1676076987154 (+2 ms)Closed at 1676076987154 2023-02-11 00:56:27,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676076969193.5d64447c702814f1edcf615760dc67d8. 2023-02-11 00:56:27,272 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 00:56:27,472 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 00:56:27,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/rep_barrier/bf79acce9092477a854b7766c44559d9 2023-02-11 00:56:27,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf79acce9092477a854b7766c44559d9 2023-02-11 00:56:27,567 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-11 00:56:27,672 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 00:56:27,673 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 00:56:27,673 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 00:56:27,873 DEBUG [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 00:56:27,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/table/99c9b42e09b449b78125f96da3517943 2023-02-11 00:56:27,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99c9b42e09b449b78125f96da3517943 2023-02-11 00:56:27,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/info/6aff39f1f75c406fba0627caa270ea07 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/info/6aff39f1f75c406fba0627caa270ea07 2023-02-11 00:56:27,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6aff39f1f75c406fba0627caa270ea07 2023-02-11 00:56:27,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/info/6aff39f1f75c406fba0627caa270ea07, entries=226, sequenceid=130, filesize=37.9 K 2023-02-11 00:56:27,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/rep_barrier/bf79acce9092477a854b7766c44559d9 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/rep_barrier/bf79acce9092477a854b7766c44559d9 2023-02-11 00:56:27,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf79acce9092477a854b7766c44559d9 2023-02-11 00:56:27,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/rep_barrier/bf79acce9092477a854b7766c44559d9, entries=1, sequenceid=130, filesize=5.0 K 2023-02-11 00:56:27,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/.tmp/table/99c9b42e09b449b78125f96da3517943 as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/table/99c9b42e09b449b78125f96da3517943 2023-02-11 00:56:27,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99c9b42e09b449b78125f96da3517943 2023-02-11 00:56:27,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/table/99c9b42e09b449b78125f96da3517943, entries=27, sequenceid=130, filesize=6.6 K 2023-02-11 00:56:27,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1253ms, sequenceid=130, compaction requested=false 2023-02-11 00:56:27,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-11 00:56:27,928 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 00:56:27,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 00:56:27,928 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676076986670Running coprocessor pre-close hooks at 1676076986670Disabling compacts and flushes for region at 1676076986670Disabling writes for close at 1676076986671 (+1 ms)Obtaining lock to block concurrent updates at 1676076986671Preparing flush snapshotting stores in 1588230740 at 1676076986671Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676076986671Flushing stores of hbase:meta,,1.1588230740 at 1676076986671Flushing 1588230740/info: creating writer at 1676076986671Flushing 1588230740/info: appending metadata at 1676076986675 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676076986675Flushing 1588230740/rep_barrier: creating writer at 1676076987084 (+409 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676076987086 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676076987086Flushing 1588230740/table: creating writer at 1676076987495 (+409 ms)Flushing 1588230740/table: appending metadata at 1676076987497 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676076987497Flushing 1588230740/info: reopening flushed file at 1676076987912 (+415 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676076987916 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676076987919 (+3 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1253ms, sequenceid=130, compaction requested=false at 1676076987924 (+5 ms)Writing region close event to WAL at 1676076987925 (+1 ms)Running coprocessor post-close hooks at 1676076987928 (+3 ms)Closed at 1676076987928 2023-02-11 00:56:27,928 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 00:56:28,073 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43697,1676076813915; all regions closed. 2023-02-11 00:56:28,080 DEBUG [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/oldWALs 2023-02-11 00:56:28,080 INFO [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43697%2C1676076813915.meta:.meta(num 1676076816972) 2023-02-11 00:56:28,083 DEBUG [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/oldWALs 2023-02-11 00:56:28,084 INFO [RS:0;jenkins-hbase4:43697] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43697%2C1676076813915:(num 1676076816025) 2023-02-11 00:56:28,084 DEBUG [RS:0;jenkins-hbase4:43697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:28,084 INFO [RS:0;jenkins-hbase4:43697] regionserver.LeaseManager(133): Closed leases 2023-02-11 00:56:28,084 INFO [RS:0;jenkins-hbase4:43697] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 00:56:28,084 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 00:56:28,085 INFO [RS:0;jenkins-hbase4:43697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43697 2023-02-11 00:56:28,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43697,1676076813915 2023-02-11 00:56:28,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 00:56:28,092 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 00:56:28,093 ERROR [Listener at localhost/36341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ac04ae5 rejected from java.util.concurrent.ThreadPoolExecutor@1effdd65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 00:56:28,095 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43697,1676076813915] 2023-02-11 00:56:28,095 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43697,1676076813915; numProcessing=1 2023-02-11 00:56:28,096 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43697,1676076813915 already deleted, retry=false 2023-02-11 00:56:28,096 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43697,1676076813915 expired; onlineServers=0 2023-02-11 00:56:28,096 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33799,1676076812795' ***** 2023-02-11 00:56:28,096 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 00:56:28,097 DEBUG [M:0;jenkins-hbase4:33799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fc78ac9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 00:56:28,097 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33799,1676076812795 2023-02-11 00:56:28,097 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33799,1676076812795; all regions closed. 2023-02-11 00:56:28,097 DEBUG [M:0;jenkins-hbase4:33799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 00:56:28,097 DEBUG [M:0;jenkins-hbase4:33799] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 00:56:28,097 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 00:56:28,097 DEBUG [M:0;jenkins-hbase4:33799] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 00:56:28,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676076815719] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676076815719,5,FailOnTimeoutGroup] 2023-02-11 00:56:28,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676076815719] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676076815719,5,FailOnTimeoutGroup] 2023-02-11 00:56:28,097 INFO [M:0;jenkins-hbase4:33799] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 00:56:28,097 INFO [M:0;jenkins-hbase4:33799] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 00:56:28,098 INFO [M:0;jenkins-hbase4:33799] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 00:56:28,098 DEBUG [M:0;jenkins-hbase4:33799] master.HMaster(1502): Stopping service threads 2023-02-11 00:56:28,098 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 00:56:28,098 INFO [M:0;jenkins-hbase4:33799] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 00:56:28,098 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 00:56:28,099 ERROR [M:0;jenkins-hbase4:33799] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 00:56:28,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-11 00:56:28,100 INFO [M:0;jenkins-hbase4:33799] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 00:56:28,100 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 00:56:28,100 DEBUG [M:0;jenkins-hbase4:33799] zookeeper.ZKUtil(398): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 00:56:28,100 WARN [M:0;jenkins-hbase4:33799] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 00:56:28,100 INFO [M:0;jenkins-hbase4:33799] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 00:56:28,100 INFO [M:0;jenkins-hbase4:33799] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 00:56:28,100 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 00:56:28,100 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:56:28,100 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:56:28,100 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 00:56:28,100 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:56:28,101 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.76 KB heapSize=598.47 KB 2023-02-11 00:56:28,109 INFO [M:0;jenkins-hbase4:33799] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.76 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28fa0dce5d094807aa3ac5fd2963302c 2023-02-11 00:56:28,112 INFO [M:0;jenkins-hbase4:33799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28fa0dce5d094807aa3ac5fd2963302c 2023-02-11 00:56:28,112 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28fa0dce5d094807aa3ac5fd2963302c as hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28fa0dce5d094807aa3ac5fd2963302c 2023-02-11 00:56:28,116 INFO [M:0;jenkins-hbase4:33799] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28fa0dce5d094807aa3ac5fd2963302c 2023-02-11 00:56:28,116 INFO [M:0;jenkins-hbase4:33799] regionserver.HStore(1080): Added hdfs://localhost:45853/user/jenkins/test-data/539a590e-3ba4-07a2-249c-5a663c2a1059/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28fa0dce5d094807aa3ac5fd2963302c, entries=123, sequenceid=1005, filesize=33.3 K 2023-02-11 00:56:28,116 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegion(2947): Finished flush of dataSize ~512.76 KB/525070, heapSize ~598.45 KB/612816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=1005, compaction requested=false 2023-02-11 00:56:28,117 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 00:56:28,117 DEBUG [M:0;jenkins-hbase4:33799] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676076988100Disabling compacts and flushes for region at 1676076988100Disabling writes for close at 1676076988100Obtaining lock to block concurrent updates at 1676076988101 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676076988101Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525070, getHeapSize=612816, getOffHeapSize=0, getCellsCount=1160 at 1676076988101Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676076988101Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676076988101Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676076988105 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676076988105Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676076988113 (+8 ms)Finished flush of dataSize ~512.76 KB/525070, heapSize ~598.45 KB/612816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=1005, compaction requested=false at 1676076988117 (+4 ms)Writing region close event to WAL at 1676076988117Closed at 1676076988117 2023-02-11 00:56:28,120 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 00:56:28,120 INFO [M:0;jenkins-hbase4:33799] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 00:56:28,120 INFO [M:0;jenkins-hbase4:33799] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33799 2023-02-11 00:56:28,122 DEBUG [M:0;jenkins-hbase4:33799] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33799,1676076812795 already deleted, retry=false 2023-02-11 00:56:28,195 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 00:56:28,195 INFO [RS:0;jenkins-hbase4:43697] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43697,1676076813915; zookeeper connection closed. 2023-02-11 00:56:28,195 ERROR [Listener at localhost/36341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7263f2aa rejected from java.util.concurrent.ThreadPoolExecutor@1effdd65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 00:56:28,195 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): regionserver:43697-0x10040de70860001, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 00:56:28,195 ERROR [Listener at localhost/36341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a18f5bc rejected from java.util.concurrent.ThreadPoolExecutor@1effdd65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 00:56:28,195 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@240e72ec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@240e72ec 2023-02-11 00:56:28,196 INFO [Listener at localhost/36341] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-11 00:56:28,295 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 00:56:28,295 INFO [M:0;jenkins-hbase4:33799] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33799,1676076812795; zookeeper connection closed. 2023-02-11 00:56:28,295 ERROR [Listener at localhost/36341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d76e1cd rejected from java.util.concurrent.ThreadPoolExecutor@6587ba8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 00:56:28,295 DEBUG [Listener at localhost/36341-EventThread] zookeeper.ZKWatcher(600): master:33799-0x10040de70860000, quorum=127.0.0.1:63942, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 00:56:28,296 ERROR [Listener at localhost/36341-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c0a6ca0 rejected from java.util.concurrent.ThreadPoolExecutor@6587ba8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 00:56:28,297 WARN [Listener at localhost/36341] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 00:56:28,300 INFO [Listener at localhost/36341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 00:56:28,408 WARN [BP-216595896-172.31.14.131-1676076809755 heartbeating to localhost/127.0.0.1:45853] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 00:56:28,408 WARN [BP-216595896-172.31.14.131-1676076809755 heartbeating to localhost/127.0.0.1:45853] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-216595896-172.31.14.131-1676076809755 (Datanode Uuid f32ddb08-ad27-4673-b5ea-ad7978885454) service to localhost/127.0.0.1:45853 2023-02-11 00:56:28,411 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/dfs/data/data1/current/BP-216595896-172.31.14.131-1676076809755] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 00:56:28,412 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c0366c5f-dd3a-e06c-6975-7fc1dab487e1/cluster_7969df08-35d6-a0c9-53be-d8ead7afda1b/dfs/data/data2/current/BP-216595896-172.31.14.131-1676076809755] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 00:56:28,439 INFO [Listener at localhost/36341] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 00:56:28,575 INFO [Listener at localhost/36341] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 00:56:28,679 INFO [Listener at localhost/36341] hbase.HBaseTestingUtility(1293): Minicluster is down