2023-03-31 16:53:33,021 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-31 16:53:33,308 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284 2023-03-31 16:53:33,323 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-31 16:53:33,324 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284, deleteOnExit=true 2023-03-31 16:53:33,324 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-31 16:53:33,324 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/test.cache.data in system properties and HBase conf 2023-03-31 16:53:33,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/hadoop.tmp.dir in system properties and HBase conf 2023-03-31 16:53:33,325 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/hadoop.log.dir in system properties and HBase conf 2023-03-31 16:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-31 16:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-31 16:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-31 16:53:33,448 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-31 16:53:33,883 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-31 16:53:33,887 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-31 16:53:33,887 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-31 16:53:33,887 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-31 16:53:33,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-31 16:53:33,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-31 16:53:33,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-31 16:53:33,888 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-31 16:53:33,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-31 16:53:33,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-31 16:53:33,890 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/nfs.dump.dir in system properties and HBase conf 2023-03-31 16:53:33,890 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/java.io.tmpdir in system properties and HBase conf 2023-03-31 16:53:33,891 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-31 16:53:33,891 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-31 16:53:33,891 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-31 16:53:34,487 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-31 16:53:34,491 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-31 16:53:34,779 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-31 16:53:34,961 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-31 16:53:34,980 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-31 16:53:35,021 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-31 16:53:35,055 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/java.io.tmpdir/Jetty_localhost_36753_hdfs____wdv81o/webapp 2023-03-31 16:53:35,203 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36753 2023-03-31 16:53:35,239 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-31 16:53:35,239 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-31 16:53:35,647 WARN [Listener at localhost/40089] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-31 16:53:35,779 WARN [Listener at localhost/40089] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-31 16:53:35,811 WARN [Listener at localhost/40089] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-31 16:53:35,819 INFO [Listener at localhost/40089] log.Slf4jLog(67): jetty-6.1.26 2023-03-31 16:53:35,833 INFO [Listener at localhost/40089] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/java.io.tmpdir/Jetty_localhost_42005_datanode____.s0bb1e/webapp 2023-03-31 16:53:35,941 INFO [Listener at localhost/40089] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42005 2023-03-31 16:53:36,308 WARN [Listener at localhost/38381] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-31 16:53:36,876 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7efe7d5e211777d0: Processing first storage report for DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e from datanode d4755885-a46f-4a45-9590-4d776a17b711 2023-03-31 16:53:36,878 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7efe7d5e211777d0: from storage DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e node DatanodeRegistration(127.0.0.1:39019, datanodeUuid=d4755885-a46f-4a45-9590-4d776a17b711, infoPort=45221, infoSecurePort=0, ipcPort=38381, storageInfo=lv=-57;cid=testClusterID;nsid=1553995170;c=1680281614568), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-31 16:53:36,878 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7efe7d5e211777d0: Processing first storage report for DS-5f537335-19e7-4b42-99d0-7806d0b85157 from datanode d4755885-a46f-4a45-9590-4d776a17b711 2023-03-31 16:53:36,878 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7efe7d5e211777d0: from storage DS-5f537335-19e7-4b42-99d0-7806d0b85157 node DatanodeRegistration(127.0.0.1:39019, datanodeUuid=d4755885-a46f-4a45-9590-4d776a17b711, infoPort=45221, infoSecurePort=0, ipcPort=38381, storageInfo=lv=-57;cid=testClusterID;nsid=1553995170;c=1680281614568), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-31 16:53:36,886 DEBUG [Listener at localhost/38381] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284 2023-03-31 16:53:36,956 INFO [Listener at localhost/38381] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/zookeeper_0, clientPort=57785, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-31 16:53:36,970 INFO [Listener at localhost/38381] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57785 2023-03-31 16:53:36,978 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:36,981 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:37,675 INFO [Listener at localhost/38381] util.FSUtils(471): Created version file at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a with version=8 2023-03-31 16:53:37,675 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/hbase-staging 2023-03-31 16:53:38,010 INFO [Listener at localhost/38381] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-31 16:53:38,526 INFO [Listener at localhost/38381] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-31 16:53:38,563 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:38,563 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:38,563 INFO [Listener at localhost/38381] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-31 16:53:38,564 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:38,564 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-31 16:53:38,734 INFO [Listener at localhost/38381] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-31 16:53:38,805 DEBUG [Listener at localhost/38381] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-31 16:53:38,903 INFO [Listener at localhost/38381] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46457 2023-03-31 16:53:39,000 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:39,002 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:39,023 INFO [Listener at localhost/38381] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46457 connecting to ZooKeeper ensemble=127.0.0.1:57785 2023-03-31 16:53:39,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:464570x0, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-31 16:53:39,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46457-0x1013b7eabf20000 connected 2023-03-31 16:53:39,270 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-31 16:53:39,271 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-31 16:53:39,274 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-31 16:53:39,284 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46457 2023-03-31 16:53:39,286 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46457 2023-03-31 16:53:39,287 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46457 2023-03-31 16:53:39,287 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46457 2023-03-31 16:53:39,287 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46457 2023-03-31 16:53:39,294 INFO [Listener at localhost/38381] master.HMaster(444): hbase.rootdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a, hbase.cluster.distributed=false 2023-03-31 16:53:39,370 INFO [Listener at localhost/38381] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-31 16:53:39,370 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:39,370 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:39,370 INFO [Listener at localhost/38381] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-31 16:53:39,370 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-31 16:53:39,371 INFO [Listener at localhost/38381] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-31 16:53:39,375 INFO [Listener at localhost/38381] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-31 16:53:39,378 INFO [Listener at localhost/38381] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41157 2023-03-31 16:53:39,380 INFO [Listener at localhost/38381] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-31 16:53:39,387 DEBUG [Listener at localhost/38381] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-31 16:53:39,388 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:39,392 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:39,395 INFO [Listener at localhost/38381] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41157 connecting to ZooKeeper ensemble=127.0.0.1:57785 2023-03-31 16:53:39,398 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:411570x0, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-31 16:53:39,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41157-0x1013b7eabf20001 connected 2023-03-31 16:53:39,399 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-31 16:53:39,401 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-31 16:53:39,402 DEBUG [Listener at localhost/38381] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-31 16:53:39,402 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41157 2023-03-31 16:53:39,403 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41157 2023-03-31 16:53:39,403 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41157 2023-03-31 16:53:39,404 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41157 2023-03-31 16:53:39,404 DEBUG [Listener at localhost/38381] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41157 2023-03-31 16:53:39,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:39,416 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-31 16:53:39,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:39,435 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-31 16:53:39,435 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-31 16:53:39,436 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:39,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-31 16:53:39,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46457,1680281617823 from backup master directory 2023-03-31 16:53:39,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-31 16:53:39,442 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:39,442 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-31 16:53:39,443 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-31 16:53:39,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:39,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-31 16:53:39,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-31 16:53:39,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/hbase.id with ID: 8dbc7b7c-6172-4d07-ac3b-8770e9eb3e8b 2023-03-31 16:53:39,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:39,602 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:39,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0f787e5f to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:39,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78e043c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:39,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-31 16:53:39,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-31 16:53:39,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-31 16:53:39,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-31 16:53:39,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-31 16:53:39,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-31 16:53:39,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-31 16:53:39,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store-tmp 2023-03-31 16:53:39,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:39,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-31 16:53:39,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:53:39,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:53:39,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-31 16:53:39,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:53:39,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:53:39,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-31 16:53:39,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/WALs/jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:39,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46457%2C1680281617823, suffix=, logDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/WALs/jenkins-hbase4.apache.org,46457,1680281617823, archiveDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/oldWALs, maxLogs=10 2023-03-31 16:53:39,876 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK] 2023-03-31 16:53:39,884 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-31 16:53:39,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/WALs/jenkins-hbase4.apache.org,46457,1680281617823/jenkins-hbase4.apache.org%2C46457%2C1680281617823.1680281619823 2023-03-31 16:53:39,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK]] 2023-03-31 16:53:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:39,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:39,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:39,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:40,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:40,035 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-31 16:53:40,061 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-31 16:53:40,075 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:40,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:40,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:40,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-31 16:53:40,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:53:40,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61895744, jitterRate=-0.0776815414428711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:53:40,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-31 16:53:40,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-31 16:53:40,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-31 16:53:40,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-31 16:53:40,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-31 16:53:40,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-31 16:53:40,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-03-31 16:53:40,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-31 16:53:40,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-31 16:53:40,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-31 16:53:40,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-31 16:53:40,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-31 16:53:40,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-31 16:53:40,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-31 16:53:40,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-31 16:53:40,261 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:40,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-31 16:53:40,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-31 16:53:40,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-31 16:53:40,283 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-31 16:53:40,283 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-31 16:53:40,283 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:40,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46457,1680281617823, sessionid=0x1013b7eabf20000, setting cluster-up flag (Was=false) 2023-03-31 16:53:40,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:40,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-31 16:53:40,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:40,311 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:40,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-31 16:53:40,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:40,323 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp 2023-03-31 16:53:40,409 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(952): ClusterId : 8dbc7b7c-6172-4d07-ac3b-8770e9eb3e8b 2023-03-31 16:53:40,415 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-31 16:53:40,425 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-31 16:53:40,428 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-31 16:53:40,439 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-31 16:53:40,441 DEBUG [RS:0;jenkins-hbase4:41157] zookeeper.ReadOnlyZKClient(139): Connect 0x3054ce79 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:40,447 DEBUG [RS:0;jenkins-hbase4:41157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e933603, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:40,448 DEBUG [RS:0;jenkins-hbase4:41157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aaca509, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-31 16:53:40,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-31 16:53:40,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-31 16:53:40,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-31 16:53:40,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-31 16:53:40,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-31 16:53:40,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-31 16:53:40,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-31 16:53:40,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1680281650474 2023-03-31 16:53:40,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-31 16:53:40,480 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-31 16:53:40,480 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-31 16:53:40,486 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-31 16:53:40,487 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41157 2023-03-31 16:53:40,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-31 16:53:40,493 INFO [RS:0;jenkins-hbase4:41157] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-31 16:53:40,493 INFO [RS:0;jenkins-hbase4:41157] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-31 16:53:40,493 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1023): About to register with Master. 2023-03-31 16:53:40,497 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46457,1680281617823 with isa=jenkins-hbase4.apache.org/172.31.14.131:41157, startcode=1680281619369 2023-03-31 16:53:40,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-31 16:53:40,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-31 16:53:40,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-31 16:53:40,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-31 16:53:40,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-31 16:53:40,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-31 16:53:40,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-31 16:53:40,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-31 16:53:40,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-31 16:53:40,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680281620514,5,FailOnTimeoutGroup] 2023-03-31 16:53:40,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680281620514,5,FailOnTimeoutGroup] 2023-03-31 16:53:40,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-31 16:53:40,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,518 DEBUG [RS:0;jenkins-hbase4:41157] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-31 16:53:40,573 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54325, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-31 16:53:40,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,601 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a 2023-03-31 16:53:40,601 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40089 2023-03-31 16:53:40,601 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-31 16:53:40,606 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-31 16:53:40,607 DEBUG [RS:0;jenkins-hbase4:41157] zookeeper.ZKUtil(162): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,607 WARN [RS:0;jenkins-hbase4:41157] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-31 16:53:40,608 INFO [RS:0;jenkins-hbase4:41157] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-31 16:53:40,608 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,609 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41157,1680281619369] 2023-03-31 16:53:40,617 DEBUG [RS:0;jenkins-hbase4:41157] zookeeper.ZKUtil(162): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,628 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-31 16:53:40,637 INFO [RS:0;jenkins-hbase4:41157] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-31 16:53:40,656 INFO [RS:0;jenkins-hbase4:41157] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-31 16:53:40,660 INFO [RS:0;jenkins-hbase4:41157] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:53:40,660 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,661 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-31 16:53:40,669 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,669 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,669 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,670 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,670 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,670 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,670 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-31 16:53:40,670 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,671 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,671 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,671 DEBUG [RS:0;jenkins-hbase4:41157] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-31 16:53:40,674 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,674 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,674 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,690 INFO [RS:0;jenkins-hbase4:41157] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-31 16:53:40,693 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41157,1680281619369-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:40,709 INFO [RS:0;jenkins-hbase4:41157] regionserver.Replication(203): jenkins-hbase4.apache.org,41157,1680281619369 started 2023-03-31 16:53:40,709 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41157,1680281619369, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41157, sessionid=0x1013b7eabf20001 2023-03-31 16:53:40,709 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-31 16:53:40,709 DEBUG [RS:0;jenkins-hbase4:41157] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,709 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41157,1680281619369' 2023-03-31 16:53:40,710 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:40,710 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:40,711 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-31 16:53:40,711 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-31 16:53:40,711 DEBUG [RS:0;jenkins-hbase4:41157] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:40,711 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41157,1680281619369' 2023-03-31 16:53:40,711 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-31 16:53:40,712 DEBUG [RS:0;jenkins-hbase4:41157] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-31 16:53:40,712 DEBUG [RS:0;jenkins-hbase4:41157] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-31 16:53:40,712 INFO [RS:0;jenkins-hbase4:41157] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-31 16:53:40,712 INFO [RS:0;jenkins-hbase4:41157] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-31 16:53:40,823 INFO [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41157%2C1680281619369, suffix=, logDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369, archiveDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/oldWALs, maxLogs=32 2023-03-31 16:53:40,843 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK] 2023-03-31 16:53:40,846 INFO [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369/jenkins-hbase4.apache.org%2C41157%2C1680281619369.1680281620825 2023-03-31 16:53:40,847 DEBUG [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK]] 2023-03-31 16:53:40,935 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:40,936 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:40,936 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a 2023-03-31 16:53:40,949 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:40,952 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-31 16:53:40,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/info 2023-03-31 16:53:40,956 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-31 16:53:40,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:40,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-31 16:53:40,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/rep_barrier 2023-03-31 16:53:40,961 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-31 16:53:40,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:40,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-31 16:53:40,964 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/table 2023-03-31 16:53:40,964 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-31 16:53:40,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:40,967 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740 2023-03-31 16:53:40,968 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740 2023-03-31 16:53:40,972 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-31 16:53:40,974 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-31 16:53:40,977 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:53:40,978 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61578894, jitterRate=-0.08240297436714172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-31 16:53:40,978 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-31 16:53:40,978 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-31 16:53:40,978 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-31 16:53:40,978 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-31 16:53:40,979 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-31 16:53:40,979 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-31 16:53:40,980 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-31 16:53:40,980 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-31 16:53:40,984 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-31 16:53:40,984 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-31 16:53:40,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-31 16:53:41,003 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-31 16:53:41,007 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-31 16:53:41,159 DEBUG [jenkins-hbase4:46457] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-31 16:53:41,162 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41157,1680281619369, state=OPENING 2023-03-31 16:53:41,169 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-31 16:53:41,172 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:41,173 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-31 16:53:41,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:41,358 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:41,361 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-31 16:53:41,364 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-31 16:53:41,376 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-31 16:53:41,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-31 16:53:41,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41157%2C1680281619369.meta, suffix=.meta, logDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369, archiveDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/oldWALs, maxLogs=32 2023-03-31 16:53:41,400 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK] 2023-03-31 16:53:41,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369/jenkins-hbase4.apache.org%2C41157%2C1680281619369.meta.1680281621383.meta 2023-03-31 16:53:41,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39019,DS-e0b60b27-09f4-44ff-bad1-a23e71b1e88e,DISK]] 2023-03-31 16:53:41,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:41,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-31 16:53:41,430 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-31 16:53:41,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-31 16:53:41,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-31 16:53:41,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:41,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-31 16:53:41,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-31 16:53:41,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-31 16:53:41,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/info 2023-03-31 16:53:41,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/info 2023-03-31 16:53:41,447 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-31 16:53:41,448 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:41,448 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-31 16:53:41,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/rep_barrier 2023-03-31 16:53:41,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/rep_barrier 2023-03-31 16:53:41,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-31 16:53:41,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:41,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-31 16:53:41,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/table 2023-03-31 16:53:41,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/table 2023-03-31 16:53:41,453 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-31 16:53:41,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:41,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740 2023-03-31 16:53:41,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740 2023-03-31 16:53:41,461 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-31 16:53:41,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-31 16:53:41,465 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62639101, jitterRate=-0.06660465896129608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-31 16:53:41,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-31 16:53:41,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1680281621351 2023-03-31 16:53:41,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-31 16:53:41,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-31 16:53:41,493 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41157,1680281619369, state=OPEN 2023-03-31 16:53:41,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-31 16:53:41,496 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-31 16:53:41,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-31 16:53:41,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41157,1680281619369 in 321 msec 2023-03-31 16:53:41,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-31 16:53:41,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 509 msec 2023-03-31 16:53:41,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1410 sec 2023-03-31 16:53:41,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1680281621510, completionTime=-1 2023-03-31 16:53:41,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-31 16:53:41,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-31 16:53:41,570 DEBUG [hconnection-0x1133b69-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:41,574 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:41,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-31 16:53:41,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1680281681592 2023-03-31 16:53:41,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1680281741592 2023-03-31 16:53:41,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 81 msec 2023-03-31 16:53:41,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46457,1680281617823-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:41,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46457,1680281617823-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:41,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46457,1680281617823-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:41,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46457, period=300000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:41,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-31 16:53:41,626 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-31 16:53:41,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-31 16:53:41,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-31 16:53:41,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-31 16:53:41,647 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:53:41,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:53:41,670 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:41,672 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1 empty. 2023-03-31 16:53:41,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:41,673 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-31 16:53:42,094 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:42,097 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7bbc72bafbb27152a2a6f4ac820714d1, NAME => 'hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:53:42,110 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:42,111 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7bbc72bafbb27152a2a6f4ac820714d1, disabling compactions & flushes 2023-03-31 16:53:42,111 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,111 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,111 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. after waiting 0 ms 2023-03-31 16:53:42,111 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,111 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,111 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7bbc72bafbb27152a2a6f4ac820714d1: 2023-03-31 16:53:42,116 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:53:42,134 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680281622120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281622120"}]},"ts":"1680281622120"} 2023-03-31 16:53:42,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:53:42,162 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:53:42,167 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281622163"}]},"ts":"1680281622163"} 2023-03-31 16:53:42,172 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-31 16:53:42,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7bbc72bafbb27152a2a6f4ac820714d1, ASSIGN}] 2023-03-31 16:53:42,184 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7bbc72bafbb27152a2a6f4ac820714d1, ASSIGN 2023-03-31 16:53:42,186 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7bbc72bafbb27152a2a6f4ac820714d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:53:42,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7bbc72bafbb27152a2a6f4ac820714d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:42,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680281622337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281622337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281622337"}]},"ts":"1680281622337"} 2023-03-31 16:53:42,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7bbc72bafbb27152a2a6f4ac820714d1, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:42,501 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7bbc72bafbb27152a2a6f4ac820714d1, NAME => 'hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:42,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:42,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,505 INFO [StoreOpener-7bbc72bafbb27152a2a6f4ac820714d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,507 DEBUG [StoreOpener-7bbc72bafbb27152a2a6f4ac820714d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/info 2023-03-31 16:53:42,508 DEBUG [StoreOpener-7bbc72bafbb27152a2a6f4ac820714d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/info 2023-03-31 16:53:42,508 INFO [StoreOpener-7bbc72bafbb27152a2a6f4ac820714d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bbc72bafbb27152a2a6f4ac820714d1 columnFamilyName info 2023-03-31 16:53:42,509 INFO [StoreOpener-7bbc72bafbb27152a2a6f4ac820714d1-1] regionserver.HStore(310): Store=7bbc72bafbb27152a2a6f4ac820714d1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:42,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:53:42,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:53:42,521 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7bbc72bafbb27152a2a6f4ac820714d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74641054, jitterRate=0.11223837733268738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:53:42,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7bbc72bafbb27152a2a6f4ac820714d1: 2023-03-31 16:53:42,523 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1., pid=6, masterSystemTime=1680281622495 2023-03-31 16:53:42,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:53:42,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7bbc72bafbb27152a2a6f4ac820714d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:42,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1680281622529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281622529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281622529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281622529"}]},"ts":"1680281622529"} 2023-03-31 16:53:42,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-31 16:53:42,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7bbc72bafbb27152a2a6f4ac820714d1, server=jenkins-hbase4.apache.org,41157,1680281619369 in 193 msec 2023-03-31 16:53:42,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-31 16:53:42,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7bbc72bafbb27152a2a6f4ac820714d1, ASSIGN in 357 msec 2023-03-31 16:53:42,544 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:53:42,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281622545"}]},"ts":"1680281622545"} 2023-03-31 16:53:42,548 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-31 16:53:42,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:53:42,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-31 16:53:42,553 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-31 16:53:42,553 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:53:42,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 915 msec 2023-03-31 16:53:42,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-31 16:53:42,611 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-31 16:53:42,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-03-31 16:53:42,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-31 16:53:42,637 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-31 16:53:42,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-03-31 16:53:42,653 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-31 16:53:42,657 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-31 16:53:42,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.214sec 2023-03-31 16:53:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-31 16:53:42,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-31 16:53:42,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-31 16:53:42,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46457,1680281617823-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-31 16:53:42,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46457,1680281617823-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-31 16:53:42,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-31 16:53:42,718 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(139): Connect 0x0672b468 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:42,723 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@561bf69b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:42,736 DEBUG [hconnection-0x78f916d2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:42,750 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:42,760 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:53:42,761 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(139): Connect 0x33fc1e18 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:42,766 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b586bb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:42,766 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:53:42,789 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=169, AvailableMemoryMB=4457 2023-03-31 16:53:42,800 DEBUG [Listener at localhost/38381] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:53:42,803 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:53:42,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:53:42,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:42,820 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:53:42,822 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:53:42,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-31 16:53:42,825 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:42,827 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 empty. 2023-03-31 16:53:42,828 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:42,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-31 16:53:42,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-31 16:53:42,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-31 16:53:43,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-31 16:53:43,246 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:43,249 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff1868f2303cdd4ae4f9f4619364c335, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing ff1868f2303cdd4ae4f9f4619364c335, disabling compactions & flushes 2023-03-31 16:53:43,269 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. after waiting 0 ms 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,269 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,269 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:43,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:53:43,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281623276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281623276"}]},"ts":"1680281623276"} 2023-03-31 16:53:43,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:53:43,280 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:53:43,280 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281623280"}]},"ts":"1680281623280"} 2023-03-31 16:53:43,282 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-31 16:53:43,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, ASSIGN}] 2023-03-31 16:53:43,289 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, ASSIGN 2023-03-31 16:53:43,290 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:53:43,442 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:43,442 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281623442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281623442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281623442"}]},"ts":"1680281623442"} 2023-03-31 16:53:43,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:43,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-31 16:53:43,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff1868f2303cdd4ae4f9f4619364c335, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:43,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:43,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,636 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,638 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:43,638 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:43,641 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff1868f2303cdd4ae4f9f4619364c335 columnFamilyName family1 2023-03-31 16:53:43,643 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(310): Store=ff1868f2303cdd4ae4f9f4619364c335/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:43,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:43,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:53:43,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff1868f2303cdd4ae4f9f4619364c335; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69392519, jitterRate=0.03402911126613617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:53:43,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:43,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., pid=11, masterSystemTime=1680281623599 2023-03-31 16:53:43,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:43,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:43,661 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281623660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281623660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281623660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281623660"}]},"ts":"1680281623660"} 2023-03-31 16:53:43,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-31 16:53:43,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369 in 218 msec 2023-03-31 16:53:43,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-31 16:53:43,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, ASSIGN in 381 msec 2023-03-31 16:53:43,671 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:53:43,672 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281623671"}]},"ts":"1680281623671"} 2023-03-31 16:53:43,674 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-31 16:53:43,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:53:43,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 862 msec 2023-03-31 16:53:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-31 16:53:43,950 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-31 16:53:43,966 DEBUG [hconnection-0x611a5737-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:43,969 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:44,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:44,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,132 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:44,132 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:44,133 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:44,133 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:44,134 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,134 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:44,135 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:44,136 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,136 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:44,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:44,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,138 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:44,141 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:44,142 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:44,143 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:44,144 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:53:44,701 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130802503f6db6b44289d5a7ebd445f1bb3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130802503f6db6b44289d5a7ebd445f1bb3 2023-03-31 16:53:44,757 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/e2ac926240f44f958b879866ef675cb7 2023-03-31 16:53:44,772 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/e2ac926240f44f958b879866ef675cb7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7 2023-03-31 16:53:44,784 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-31 16:53:44,787 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 643ms, sequenceid=5, compaction requested=false 2023-03-31 16:53:44,790 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:44,798 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:44,798 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:44,798 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:44,799 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:44,799 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,799 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:44,799 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:44,809 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,810 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:44,813 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a898db[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:44,813 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,816 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:44,816 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:44,816 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:44,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:44,820 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:44,824 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:44,824 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:44,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:44,824 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:44,824 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,825 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:44,829 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,829 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:44,829 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:44,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:44,830 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:44,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,832 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,842 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:44,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,843 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,843 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:44,844 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,844 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:44,846 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:44,846 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:44,946 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:44,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:44,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,984 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:44,984 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:44,985 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:44,985 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:44,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:44,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:44,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,989 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:44,989 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:44,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,992 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:44,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:44,992 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:44,992 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:45,016 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:45,016 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:45,016 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:53:45,125 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112857da4320974b447baa0b326cbb951c98 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112857da4320974b447baa0b326cbb951c98 2023-03-31 16:53:45,145 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/bca36a66bafc46d4b9faa19f88003d31 2023-03-31 16:53:45,157 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/bca36a66bafc46d4b9faa19f88003d31 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31 2023-03-31 16:53:45,176 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:53:45,178 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 162ms, sequenceid=9, compaction requested=false 2023-03-31 16:53:45,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:45,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:45,182 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,182 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,183 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,183 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3910ddff[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:45,186 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:45,186 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,188 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:45,189 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,189 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:45,192 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:45,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:45,200 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:45,200 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:45,200 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:45,200 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,200 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:45,206 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,207 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:45,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,207 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:45,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:45,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,212 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,215 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:45,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:45,223 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,223 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:45,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:45,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:45,223 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:45,224 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:45,224 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,224 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,224 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:45,224 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:45,325 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:45,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:45,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:45,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,356 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:45,356 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:45,364 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:45,364 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:45,365 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,365 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,367 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:45,368 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:45,370 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,370 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:45,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:45,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,379 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,380 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:45,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:45,381 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:45,381 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:45,381 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:45,381 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:45,381 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:45,456 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120192ffcb0fcbd14bcd94a7eeb058f7fe8d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120192ffcb0fcbd14bcd94a7eeb058f7fe8d 2023-03-31 16:53:45,881 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/35ab8c4c87924bffa8c03099426fa6f3 2023-03-31 16:53:45,894 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/35ab8c4c87924bffa8c03099426fa6f3 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3 2023-03-31 16:53:45,910 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3, entries=1, sequenceid=13, filesize=5.0 K 2023-03-31 16:53:45,913 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 532ms, sequenceid=13, compaction requested=true 2023-03-31 16:53:45,913 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:45,913 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:45,913 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:45,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:45,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:45,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:45,918 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,921 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:45,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e9f6675[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:45,921 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:45,921 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,922 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:45,921 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,925 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,925 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,925 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:45,925 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:45,925 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:45,927 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,927 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:45,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,927 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,928 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:45,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:45,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:45,934 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:45,934 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:45,934 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:45,934 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,934 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:45,936 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,937 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,937 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:45,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:45,937 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:45,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:45,940 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:45,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:45,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:45,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:45,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:45,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,950 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,950 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:45,950 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,950 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,950 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:45,950 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:45,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:45,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:45,951 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:45,951 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:45,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:46,051 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:46,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:46,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:46,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,077 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:46,077 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:46,077 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:46,077 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:46,078 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,078 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,080 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:46,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,081 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:46,081 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:46,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,082 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,082 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:46,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:46,085 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:46,085 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:46,085 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:46,085 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:46,085 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:46,554 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cca583c88e0140b68b37c70842072a6c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205cca583c88e0140b68b37c70842072a6c 2023-03-31 16:53:46,975 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:53:46,990 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/1f2a9f63ef01427487b377a2ade080d6 2023-03-31 16:53:47,007 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/1f2a9f63ef01427487b377a2ade080d6 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6 2023-03-31 16:53:47,021 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6, entries=1, sequenceid=17, filesize=5.0 K 2023-03-31 16:53:47,023 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 938ms, sequenceid=17, compaction requested=true 2023-03-31 16:53:47,023 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:47,023 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:47,023 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:47,025 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:47,025 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,025 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:47,025 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:47,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,028 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,029 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,029 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:47,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f3d9521[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:47,032 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:47,032 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,033 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:47,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:47,034 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,034 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:47,036 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,036 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:47,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,036 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:47,036 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:47,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:47,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:47,048 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:47,049 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:47,049 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:47,049 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,049 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:47,055 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,055 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,055 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:47,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,056 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,060 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:47,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,067 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:47,068 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:47,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:47,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:47,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,069 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,069 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,070 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:47,070 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:47,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:47,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:47,108 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-31 16:53:47,109 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-31 16:53:47,170 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:47,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:47,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:47,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:47,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,183 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:47,184 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:47,193 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:47,193 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:47,194 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,194 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,196 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,196 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,198 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:47,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:47,198 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:47,199 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:47,199 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:47,199 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:47,199 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:47,199 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:47,241 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228eabc6843a7cd424b8559e6fe96c93a4a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228eabc6843a7cd424b8559e6fe96c93a4a 2023-03-31 16:53:47,256 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/3b29c9d886134b56a5e9ecac95f73d81 2023-03-31 16:53:47,266 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/3b29c9d886134b56a5e9ecac95f73d81 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81 2023-03-31 16:53:47,277 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81, entries=1, sequenceid=21, filesize=5.0 K 2023-03-31 16:53:47,279 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 80ms, sequenceid=21, compaction requested=true 2023-03-31 16:53:47,279 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:47,279 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:47,279 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:47,280 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:47,280 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,280 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:47,280 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:47,285 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:47,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5814a85d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:47,289 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:47,289 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,290 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:47,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:47,291 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,291 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:47,292 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:47,297 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:47,297 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:47,297 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:47,297 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,297 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:47,300 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,300 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,300 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,301 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,303 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:47,306 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:47,306 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,307 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,307 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:47,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:47,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:47,307 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:47,308 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:47,308 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:47,408 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:47,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:47,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:47,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:47,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,432 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:47,432 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:47,433 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:47,433 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:47,433 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,434 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,435 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:47,435 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:47,436 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,436 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:47,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:47,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,439 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:47,439 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:47,439 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:47,440 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:47,440 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:47,440 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:47,440 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:47,440 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:47,497 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231850ab3382f714b3da4f71ef5dbee440b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231850ab3382f714b3da4f71ef5dbee440b 2023-03-31 16:53:47,930 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/82203373795a4d5bb47aa2cdef140800 2023-03-31 16:53:47,942 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/82203373795a4d5bb47aa2cdef140800 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800 2023-03-31 16:53:47,961 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800, entries=1, sequenceid=25, filesize=5.0 K 2023-03-31 16:53:47,976 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 536ms, sequenceid=25, compaction requested=true 2023-03-31 16:53:47,976 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:47,976 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:47,979 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,979 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,979 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,980 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:47,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:47,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67546985[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:47,983 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:47,983 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,986 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:47,986 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:47,990 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,991 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:47,992 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:47,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:47,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:47,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:48,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:48,005 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:48,005 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:48,005 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-31 16:53:48,005 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:48,005 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,005 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:48,005 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-31 16:53:48,007 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,007 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,007 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,009 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,011 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:48,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:48,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,016 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:48,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,017 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,017 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,017 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,017 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:48,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:48,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:48,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,018 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:48,018 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:48,118 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:48,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,140 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:48,140 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:48,141 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:48,141 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:48,142 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,142 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:48,144 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:48,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:48,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,144 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,145 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:48,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,147 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:48,148 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:48,149 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:48,152 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:48,152 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:48,152 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:48,152 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:48,152 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:48,621 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101399106e4f209483ebf002746165232c1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101399106e4f209483ebf002746165232c1 2023-03-31 16:53:48,664 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/14e9a015330e44ddb180c8b490c3fe39 2023-03-31 16:53:48,679 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/14e9a015330e44ddb180c8b490c3fe39 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39 2023-03-31 16:53:48,688 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39, entries=1, sequenceid=29, filesize=5.0 K 2023-03-31 16:53:48,690 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 538ms, sequenceid=29, compaction requested=true 2023-03-31 16:53:48,690 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:48,690 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:48,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:48,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:48,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:48,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:48,694 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,694 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,695 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627d07d4[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:48,698 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:48,698 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,701 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:48,701 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:48,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:48,703 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:48,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:48,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:48,707 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:48,707 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:48,707 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:48,707 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,707 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:48,709 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,709 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,709 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,710 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,716 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:48,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:48,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,723 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:48,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:48,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:48,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:48,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,724 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,724 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,725 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,725 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:48,725 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:48,725 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:48,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,825 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:48,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:48,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:48,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:48,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,846 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:48,846 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:48,847 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:48,847 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:48,848 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,848 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,849 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,850 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:48,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:48,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,850 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,851 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:48,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:48,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,860 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:48,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,860 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:48,860 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:48,867 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:48,869 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:48,869 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:48,869 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:48,869 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:48,870 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:48,909 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010398de64dd44f04389adef708a902498db to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010398de64dd44f04389adef708a902498db 2023-03-31 16:53:48,930 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/81adab2715e94615a853633a47a1be31 2023-03-31 16:53:48,940 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/81adab2715e94615a853633a47a1be31 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31 2023-03-31 16:53:48,954 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31, entries=1, sequenceid=33, filesize=5.0 K 2023-03-31 16:53:48,956 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 86ms, sequenceid=33, compaction requested=true 2023-03-31 16:53:48,956 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:48,956 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:48,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:48,959 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,959 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,959 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,959 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:48,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@119a1227[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:48,962 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:48,962 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,963 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,963 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:48,963 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:48,963 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:48,963 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,963 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:48,966 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:48,966 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:48,966 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:48,968 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:48,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:48,975 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:48,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:48,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:48,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,975 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:48,978 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:48,979 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,979 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,980 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:48,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,982 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:48,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,985 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:48,986 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:48,986 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:48,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:48,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-31 16:53:48,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:48,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:48,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:48,986 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:48,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:48,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:48,987 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:48,988 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:49,088 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:49,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:49,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:49,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:49,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,108 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:49,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:49,109 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:49,109 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:49,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,111 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,111 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:49,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:49,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:49,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:49,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,113 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:49,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,133 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:49,133 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:49,135 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:49,135 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:49,135 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:49,135 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:49,231 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d601a5d4f31c42479c735a38a19f15d1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907d601a5d4f31c42479c735a38a19f15d1 2023-03-31 16:53:49,271 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/57e74ddf290c420e91d5592b7ee2df90 2023-03-31 16:53:49,287 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/57e74ddf290c420e91d5592b7ee2df90 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90 2023-03-31 16:53:49,302 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90, entries=1, sequenceid=37, filesize=5.0 K 2023-03-31 16:53:49,304 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 169ms, sequenceid=37, compaction requested=true 2023-03-31 16:53:49,304 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:49,305 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:49,305 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,306 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:49,306 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:49,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,310 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,310 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,310 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:49,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cb11609[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:49,313 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:49,313 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,314 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,315 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:49,315 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:49,315 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:49,315 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,315 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:49,316 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:49,317 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:49,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:49,322 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:49,322 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:49,322 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:49,322 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,322 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:49,324 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,324 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:49,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,324 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:49,325 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,328 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,339 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,339 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:49,339 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:49,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:49,339 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:49,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:49,339 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:49,340 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:49,341 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:49,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:49,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:49,441 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:49,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:49,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:49,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:49,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,458 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:49,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:49,459 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-31 16:53:49,459 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-31 16:53:49,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:49,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,465 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,465 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,466 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:49,466 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,466 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-31 16:53:49,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-31 16:53:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:49,468 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-31 16:53:49,469 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:49,469 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:49,469 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:49,469 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. started... 2023-03-31 16:53:49,469 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff1868f2303cdd4ae4f9f4619364c335 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:49,511 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112066c62c9ba4dc4ac8927434366f158539 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112066c62c9ba4dc4ac8927434366f158539 2023-03-31 16:53:49,925 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/382104d3a75c42229ec5231bab5c09b0 2023-03-31 16:53:49,941 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/382104d3a75c42229ec5231bab5c09b0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0 2023-03-31 16:53:49,950 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0, entries=1, sequenceid=41, filesize=5.0 K 2023-03-31 16:53:49,953 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff1868f2303cdd4ae4f9f4619364c335 in 484ms, sequenceid=41, compaction requested=true 2023-03-31 16:53:49,953 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:49,953 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-31 16:53:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-31 16:53:49,957 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-31 16:53:49,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286d525b[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:49,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-31 16:53:49,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,960 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,961 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-31 16:53:49,961 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-31 16:53:49,961 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:49,961 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,961 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:49,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,965 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-31 16:53:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,965 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:49,966 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-31 16:53:49,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:49,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-31 16:53:49,973 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-31 16:53:49,973 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:49,973 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:49,973 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,973 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:49,975 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,975 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,975 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:49,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:49,976 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,978 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,987 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:49,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-31 16:53:49,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:49,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:49,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:49,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:49,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:49,988 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:49,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:49,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:50,089 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:50,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:50,097 DEBUG [Listener at localhost/38381] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-31 16:53:50,104 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34196, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-31 16:53:50,106 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:50,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:50,131 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:50,134 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282230133 2023-03-31 16:53:50,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:53:50,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:53:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-31 16:53:50,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:50,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x185e2a96 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:50,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6680fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:50,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:50,809 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103147aefb26f4e4bb5bb0e195f49ffdefd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103147aefb26f4e4bb5bb0e195f49ffdefd 2023-03-31 16:53:50,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:50,839 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:50,841 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:50,863 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:53:50,865 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:53:50,949 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a1a5302c73a4f5da98956cebaf3da4b first=Optional[r3] last=Optional[r6] 2023-03-31 16:53:50,968 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a1a5302c73a4f5da98956cebaf3da4b}] 2023-03-31 16:53:50,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a1a5302c73a4f5da98956cebaf3da4b for inclusion in ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:51,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-31 16:53:51,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:53:51,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:51,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a1a5302c73a4f5da98956cebaf3da4b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__js0fb5gth35lsmh4c0dibplj0mnsa50jcisulr0idg4nnb1vmbr5iupngp466d7f/family1/7a1a5302c73a4f5da98956cebaf3da4b 2023-03-31 16:53:51,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__js0fb5gth35lsmh4c0dibplj0mnsa50jcisulr0idg4nnb1vmbr5iupngp466d7f/family1/7a1a5302c73a4f5da98956cebaf3da4b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_ 2023-03-31 16:53:51,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__js0fb5gth35lsmh4c0dibplj0mnsa50jcisulr0idg4nnb1vmbr5iupngp466d7f/family1/7a1a5302c73a4f5da98956cebaf3da4b into ff1868f2303cdd4ae4f9f4619364c335/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_ - updating store file list. 2023-03-31 16:53:51,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_ into ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:51,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__js0fb5gth35lsmh4c0dibplj0mnsa50jcisulr0idg4nnb1vmbr5iupngp466d7f/family1/7a1a5302c73a4f5da98956cebaf3da4b into ff1868f2303cdd4ae4f9f4619364c335/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_) 2023-03-31 16:53:51,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__js0fb5gth35lsmh4c0dibplj0mnsa50jcisulr0idg4nnb1vmbr5iupngp466d7f/family1/7a1a5302c73a4f5da98956cebaf3da4b 2023-03-31 16:53:51,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:53:51,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:53:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): ff1868f2303cdd4ae4f9f4619364c335/family1 is initiating minor compaction 2023-03-31 16:53:51,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@61f1ffd5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:51,043 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff1868f2303cdd4ae4f9f4619364c335/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:51,047 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp, totalSize=50.2 K 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting bca36a66bafc46d4b9faa19f88003d31, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 35ab8c4c87924bffa8c03099426fa6f3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 1f2a9f63ef01427487b377a2ade080d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 3b29c9d886134b56a5e9ecac95f73d81, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 82203373795a4d5bb47aa2cdef140800, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 14e9a015330e44ddb180c8b490c3fe39, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 81adab2715e94615a853633a47a1be31, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:53:51,048 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 57e74ddf290c420e91d5592b7ee2df90, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:53:51,049 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 382104d3a75c42229ec5231bab5c09b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:53:51,049 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:53:51,070 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:51,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:51,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228eabc6843a7cd424b8559e6fe96c93a4a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228eabc6843a7cd424b8559e6fe96c93a4a 2023-03-31 16:53:51,082 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231850ab3382f714b3da4f71ef5dbee440b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231850ab3382f714b3da4f71ef5dbee440b 2023-03-31 16:53:51,087 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101399106e4f209483ebf002746165232c1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101399106e4f209483ebf002746165232c1 2023-03-31 16:53:51,090 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010398de64dd44f04389adef708a902498db to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010398de64dd44f04389adef708a902498db 2023-03-31 16:53:51,090 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-31 16:53:51,090 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,161 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff1868f2303cdd4ae4f9f4619364c335#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:53:51,311 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059d1ecc97963d452fadf880b5010e14b4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512059d1ecc97963d452fadf880b5010e14b4 2023-03-31 16:53:51,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:51,380 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0eee5e13a04d40d783a30f7a5c8a8e17 first=Optional[r00] last=Optional[r2] 2023-03-31 16:53:51,384 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0eee5e13a04d40d783a30f7a5c8a8e17}] 2023-03-31 16:53:51,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0eee5e13a04d40d783a30f7a5c8a8e17 for inclusion in ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:51,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-31 16:53:51,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:53:51,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:51,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0eee5e13a04d40d783a30f7a5c8a8e17 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qugjd4km2u578qcn5b3pe0spunggl4kk9cjhs3k263j90b192v7if4pnifjd89u8/family1/0eee5e13a04d40d783a30f7a5c8a8e17 2023-03-31 16:53:51,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qugjd4km2u578qcn5b3pe0spunggl4kk9cjhs3k263j90b192v7if4pnifjd89u8/family1/0eee5e13a04d40d783a30f7a5c8a8e17 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ 2023-03-31 16:53:51,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qugjd4km2u578qcn5b3pe0spunggl4kk9cjhs3k263j90b192v7if4pnifjd89u8/family1/0eee5e13a04d40d783a30f7a5c8a8e17 into ff1868f2303cdd4ae4f9f4619364c335/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ - updating store file list. 2023-03-31 16:53:51,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ into ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:51,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qugjd4km2u578qcn5b3pe0spunggl4kk9cjhs3k263j90b192v7if4pnifjd89u8/family1/0eee5e13a04d40d783a30f7a5c8a8e17 into ff1868f2303cdd4ae4f9f4619364c335/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_) 2023-03-31 16:53:51,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__qugjd4km2u578qcn5b3pe0spunggl4kk9cjhs3k263j90b192v7if4pnifjd89u8/family1/0eee5e13a04d40d783a30f7a5c8a8e17 2023-03-31 16:53:51,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:51,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:51,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130802503f6db6b44289d5a7ebd445f1bb3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130802503f6db6b44289d5a7ebd445f1bb3 2023-03-31 16:53:51,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120192ffcb0fcbd14bcd94a7eeb058f7fe8d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120192ffcb0fcbd14bcd94a7eeb058f7fe8d 2023-03-31 16:53:51,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205cca583c88e0140b68b37c70842072a6c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205cca583c88e0140b68b37c70842072a6c 2023-03-31 16:53:51,429 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-31 16:53:51,429 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-31 16:53:51,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:51,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:51,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:53:51,431 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:51,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.3200 sec 2023-03-31 16:53:51,665 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/b537ea1a43804cfeb88687ea12958b68 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68 2023-03-31 16:53:51,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-31 16:53:51,698 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ff1868f2303cdd4ae4f9f4619364c335/family1 of ff1868f2303cdd4ae4f9f4619364c335 into b537ea1a43804cfeb88687ea12958b68(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:53:51,699 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:51,701 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1680281631039; duration=0sec 2023-03-31 16:53:51,702 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:51,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:51,748 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-31 16:53:51,750 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:51,750 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-31 16:53:51,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-31 16:53:51,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, REOPEN/MOVE}] 2023-03-31 16:53:51,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_] to archive 2023-03-31 16:53:51,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:51,787 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, REOPEN/MOVE 2023-03-31 16:53:51,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:51,790 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281631789"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281631789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281631789"}]},"ts":"1680281631789"} 2023-03-31 16:53:51,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/bca36a66bafc46d4b9faa19f88003d31 2023-03-31 16:53:51,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:51,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/35ab8c4c87924bffa8c03099426fa6f3 2023-03-31 16:53:51,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/1f2a9f63ef01427487b377a2ade080d6 2023-03-31 16:53:51,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/3b29c9d886134b56a5e9ecac95f73d81 2023-03-31 16:53:51,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/82203373795a4d5bb47aa2cdef140800 2023-03-31 16:53:51,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/14e9a015330e44ddb180c8b490c3fe39 2023-03-31 16:53:51,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/81adab2715e94615a853633a47a1be31 2023-03-31 16:53:51,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/57e74ddf290c420e91d5592b7ee2df90 2023-03-31 16:53:51,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/382104d3a75c42229ec5231bab5c09b0 2023-03-31 16:53:51,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5fb184a1119f438f81c634bf1bb1b8eb_SeqId_44_ 2023-03-31 16:53:51,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:51,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff1868f2303cdd4ae4f9f4619364c335, disabling compactions & flushes 2023-03-31 16:53:51,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:51,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:51,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. after waiting 0 ms 2023-03-31 16:53:51,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:51,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-31 16:53:51,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:51,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:51,969 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: ff1868f2303cdd4ae4f9f4619364c335 to self. 2023-03-31 16:53:51,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:51,976 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=CLOSED 2023-03-31 16:53:51,976 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281631976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281631976"}]},"ts":"1680281631976"} 2023-03-31 16:53:51,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-31 16:53:51,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369 in 185 msec 2023-03-31 16:53:51,982 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=true 2023-03-31 16:53:52,132 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:52,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281632132"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281632132"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281632132"}]},"ts":"1680281632132"} 2023-03-31 16:53:52,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:52,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:52,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff1868f2303cdd4ae4f9f4619364c335, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:52,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:52,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,297 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,298 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:52,298 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:52,299 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff1868f2303cdd4ae4f9f4619364c335 columnFamilyName family1 2023-03-31 16:53:52,316 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ 2023-03-31 16:53:52,328 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68 2023-03-31 16:53:52,336 DEBUG [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7 2023-03-31 16:53:52,336 INFO [StoreOpener-ff1868f2303cdd4ae4f9f4619364c335-1] regionserver.HStore(310): Store=ff1868f2303cdd4ae4f9f4619364c335/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:52,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:53:52,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff1868f2303cdd4ae4f9f4619364c335; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64408246, jitterRate=-0.04024234414100647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:53:52,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:52,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., pid=17, masterSystemTime=1680281632289 2023-03-31 16:53:52,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:52,358 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:53:52,361 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:53:52,361 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1912): ff1868f2303cdd4ae4f9f4619364c335/family1 is initiating minor compaction (all files) 2023-03-31 16:53:52,361 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff1868f2303cdd4ae4f9f4619364c335/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:52,361 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp, totalSize=358.6 K 2023-03-31 16:53:52,362 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting e2ac926240f44f958b879866ef675cb7, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:53:52,363 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting b537ea1a43804cfeb88687ea12958b68, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:53:52,363 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878842768 2023-03-31 16:53:52,369 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ff1868f2303cdd4ae4f9f4619364c335, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:52,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:52,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:53:52,370 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1680281632369"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281632369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281632369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281632369"}]},"ts":"1680281632369"} 2023-03-31 16:53:52,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-31 16:53:52,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure ff1868f2303cdd4ae4f9f4619364c335, server=jenkins-hbase4.apache.org,41157,1680281619369 in 236 msec 2023-03-31 16:53:52,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-31 16:53:52,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=ff1868f2303cdd4ae4f9f4619364c335, REOPEN/MOVE in 592 msec 2023-03-31 16:53:52,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-31 16:53:52,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 625 msec 2023-03-31 16:53:52,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 687 msec 2023-03-31 16:53:52,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-31 16:53:52,408 INFO [Listener at localhost/38381] compactions.TestMobCompactor(278): alter status finished 2023-03-31 16:53:52,410 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-31 16:53:52,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:52,414 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff1868f2303cdd4ae4f9f4619364c335#family1#compaction#11 average throughput is 5.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:53:52,417 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:52,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:53:52,419 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282232419 2023-03-31 16:53:52,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:53:52,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-31 16:53:52,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:52,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x68f806a8 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:52,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13def61f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:52,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,567 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a623a7d774c9405886a67629fd5e3fb9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a623a7d774c9405886a67629fd5e3fb9 2023-03-31 16:53:52,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:52,585 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:52,586 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46694, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:52,607 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:53:52,610 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:53:52,683 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c517ece4cd9f4742837bc7d008894a18 first=Optional[r05] last=Optional[r8] 2023-03-31 16:53:52,684 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=50 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c517ece4cd9f4742837bc7d008894a18}] 2023-03-31 16:53:52,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c517ece4cd9f4742837bc7d008894a18 for inclusion in ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:52,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-31 16:53:52,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:53:52,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:52,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c517ece4cd9f4742837bc7d008894a18 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__k2g4hbkccuvl729grbafhs3r0u6434rse58t9ig82nnmpnbeppnj0svucbsb6ne5/family1/c517ece4cd9f4742837bc7d008894a18 2023-03-31 16:53:52,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__k2g4hbkccuvl729grbafhs3r0u6434rse58t9ig82nnmpnbeppnj0svucbsb6ne5/family1/c517ece4cd9f4742837bc7d008894a18 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/8a86709f14cb4bb6b71b85f4155b1b8a_SeqId_52_ 2023-03-31 16:53:52,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__k2g4hbkccuvl729grbafhs3r0u6434rse58t9ig82nnmpnbeppnj0svucbsb6ne5/family1/c517ece4cd9f4742837bc7d008894a18 into ff1868f2303cdd4ae4f9f4619364c335/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/8a86709f14cb4bb6b71b85f4155b1b8a_SeqId_52_ - updating store file list. 2023-03-31 16:53:52,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/8a86709f14cb4bb6b71b85f4155b1b8a_SeqId_52_ into ff1868f2303cdd4ae4f9f4619364c335/family1 2023-03-31 16:53:52,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__k2g4hbkccuvl729grbafhs3r0u6434rse58t9ig82nnmpnbeppnj0svucbsb6ne5/family1/c517ece4cd9f4742837bc7d008894a18 into ff1868f2303cdd4ae4f9f4619364c335/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/8a86709f14cb4bb6b71b85f4155b1b8a_SeqId_52_) 2023-03-31 16:53:52,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__k2g4hbkccuvl729grbafhs3r0u6434rse58t9ig82nnmpnbeppnj0svucbsb6ne5/family1/c517ece4cd9f4742837bc7d008894a18 2023-03-31 16:53:52,735 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:52,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:52,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112066c62c9ba4dc4ac8927434366f158539 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112066c62c9ba4dc4ac8927434366f158539 2023-03-31 16:53:52,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112857da4320974b447baa0b326cbb951c98 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112857da4320974b447baa0b326cbb951c98 2023-03-31 16:53:52,744 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-31 16:53:52,744 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-31 16:53:52,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-31 16:53:52,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-31 16:53:52,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:53:52,749 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-31 16:53:52,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 338 msec 2023-03-31 16:53:52,937 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 209) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45330 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45388 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cc79d331b9f849caa0454ddcff93c9c9 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45288 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45270 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26a2b967-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45512 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45470 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45472 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x185e2a96 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1808081689.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bc00040-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-2102574042-172.31.14.131-1680281614568:blk_1073741865_1041 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x68f806a8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1808081689.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1704487208_15 at /127.0.0.1:45582 [Receiving block BP-2102574042-172.31.14.131-1680281614568:blk_1073741865_1041] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bc00040-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26a2b967-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45412 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/88ce75e4d84e43929c70f2bed7ecddd4 block BP-2102574042-172.31.14.131-1680281614568:blk_1073741865_1041 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45426 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x68f806a8-SendThread(127.0.0.1:57785) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x3bc00040-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45574 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1704487208_15 at /127.0.0.1:45458 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45452 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3bc00040-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x185e2a96-SendThread(127.0.0.1:57785) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x26a2b967-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x68f806a8-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45372 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45484 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-2102574042-172.31.14.131-1680281614568:blk_1073741865_1041, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45398 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:41157-shortCompactions-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:940) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:880) org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:863) org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:818) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.finishClose(HFileWriterImpl.java:820) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.close(HFileWriterImpl.java:654) org.apache.hadoop.hbase.regionserver.StoreFileWriter.close(StoreFileWriter.java:359) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.abortWriter(DefaultCompactor.java:97) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.performCompaction(DefaultMobStoreCompactor.java:350) org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:337) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.compact(DefaultMobStoreCompactor.java:108) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1473) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2267) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:625) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:673) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x185e2a96-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x3bc00040-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=598 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 333) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4071 (was 4457) 2023-03-31 16:53:52,961 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=169, AvailableMemoryMB=4069 2023-03-31 16:53:52,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-31 16:53:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:52,967 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:53:52,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-31 16:53:52,969 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:53:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-31 16:53:52,976 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:52,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55 empty. 2023-03-31 16:53:52,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:52,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-31 16:53:53,012 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-31 16:53:53,013 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 007079f1db1ff7051238b27d5352ab55, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 007079f1db1ff7051238b27d5352ab55, disabling compactions & flushes 2023-03-31 16:53:53,052 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. after waiting 0 ms 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,052 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:53,056 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:53:53,057 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281633057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281633057"}]},"ts":"1680281633057"} 2023-03-31 16:53:53,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:53:53,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:53:53,061 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281633061"}]},"ts":"1680281633061"} 2023-03-31 16:53:53,063 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-31 16:53:53,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=007079f1db1ff7051238b27d5352ab55, ASSIGN}] 2023-03-31 16:53:53,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-31 16:53:53,079 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=007079f1db1ff7051238b27d5352ab55, ASSIGN 2023-03-31 16:53:53,080 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=007079f1db1ff7051238b27d5352ab55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:53:53,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=007079f1db1ff7051238b27d5352ab55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:53,232 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281633232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281633232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281633232"}]},"ts":"1680281633232"} 2023-03-31 16:53:53,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 007079f1db1ff7051238b27d5352ab55, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:53:53,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-31 16:53:53,315 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/.tmp/family1/88ce75e4d84e43929c70f2bed7ecddd4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/88ce75e4d84e43929c70f2bed7ecddd4 2023-03-31 16:53:53,343 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ff1868f2303cdd4ae4f9f4619364c335/family1 of ff1868f2303cdd4ae4f9f4619364c335 into 88ce75e4d84e43929c70f2bed7ecddd4(size=177.2 K), total size for store is 182.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:53:53,343 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:53:53,344 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335., storeName=ff1868f2303cdd4ae4f9f4619364c335/family1, priority=13, startTime=1680281632357; duration=0sec 2023-03-31 16:53:53,344 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:53,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_] to archive 2023-03-31 16:53:53,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:53,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/e2ac926240f44f958b879866ef675cb7 2023-03-31 16:53:53,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/b537ea1a43804cfeb88687ea12958b68 2023-03-31 16:53:53,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/family1/5d7ca86f150e46eaa97a76c1d42ec1d2_SeqId_46_ 2023-03-31 16:53:53,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 007079f1db1ff7051238b27d5352ab55, NAME => 'testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:53:53,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:53:53,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,396 INFO [StoreOpener-007079f1db1ff7051238b27d5352ab55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,408 DEBUG [StoreOpener-007079f1db1ff7051238b27d5352ab55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:53,408 DEBUG [StoreOpener-007079f1db1ff7051238b27d5352ab55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:53,409 INFO [StoreOpener-007079f1db1ff7051238b27d5352ab55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 007079f1db1ff7051238b27d5352ab55 columnFamilyName family1 2023-03-31 16:53:53,411 INFO [StoreOpener-007079f1db1ff7051238b27d5352ab55-1] regionserver.HStore(310): Store=007079f1db1ff7051238b27d5352ab55/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:53:53,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:53:53,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:53:53,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 007079f1db1ff7051238b27d5352ab55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63303142, jitterRate=-0.05670967698097229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:53:53,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:53,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., pid=21, masterSystemTime=1680281633387 2023-03-31 16:53:53,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,430 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=007079f1db1ff7051238b27d5352ab55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:53,430 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281633430"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281633430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281633430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281633430"}]},"ts":"1680281633430"} 2023-03-31 16:53:53,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-31 16:53:53,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 007079f1db1ff7051238b27d5352ab55, server=jenkins-hbase4.apache.org,41157,1680281619369 in 199 msec 2023-03-31 16:53:53,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-31 16:53:53,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=007079f1db1ff7051238b27d5352ab55, ASSIGN in 362 msec 2023-03-31 16:53:53,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:53:53,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281633440"}]},"ts":"1680281633440"} 2023-03-31 16:53:53,442 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-31 16:53:53,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:53:53,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 482 msec 2023-03-31 16:53:53,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-31 16:53:53,577 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-31 16:53:53,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:53,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,632 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:53,632 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:53,633 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:53,633 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:53,633 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,634 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,636 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:53,636 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:53,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:53,636 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:53,636 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:53,641 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:53,641 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:53,641 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:53,641 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:53,642 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:53:53,735 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130448d81aecde9450da2e0c0d84d9ab940 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130448d81aecde9450da2e0c0d84d9ab940 2023-03-31 16:53:54,142 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/8c88da9b58334c9ea1ee9b3ddc028f63 2023-03-31 16:53:54,150 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/8c88da9b58334c9ea1ee9b3ddc028f63 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63 2023-03-31 16:53:54,157 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-31 16:53:54,159 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 518ms, sequenceid=5, compaction requested=false 2023-03-31 16:53:54,159 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:54,161 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:54,161 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:54,163 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,164 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:54,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2224b325[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:54,166 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:54,166 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,167 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:54,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:54,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:54,168 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,168 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:54,171 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:54,171 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,171 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:54,171 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:54,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:54,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:54,175 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:54,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:54,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:54,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,175 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:54,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,180 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,181 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,184 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,184 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:54,184 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:54,184 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:54,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:54,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:54,184 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:54,185 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:54,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:54,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:54,286 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:54,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:54,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:54,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:54,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,297 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:54,297 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,298 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,299 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:54,299 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:54,300 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,300 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,304 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:54,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,304 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:54,304 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:54,305 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:54,309 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:54,309 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:54,309 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:54,309 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:54,309 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:53:54,734 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fba5f6740f724e2ab0eaf98c21118378 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128fba5f6740f724e2ab0eaf98c21118378 2023-03-31 16:53:54,741 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/e820c117bcbd4588a74b3d41a52e627e 2023-03-31 16:53:54,751 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/e820c117bcbd4588a74b3d41a52e627e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e 2023-03-31 16:53:54,764 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:53:54,765 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 456ms, sequenceid=9, compaction requested=false 2023-03-31 16:53:54,766 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:54,766 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:54,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:54,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:54,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:54,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:54,806 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,806 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,807 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,807 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@636e966c[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:54,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:54,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,837 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,837 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,838 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:54,838 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:54,838 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:54,838 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:54,868 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:54,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:54,874 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:54,874 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:54,874 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:54,874 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,874 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:54,891 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,891 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:54,891 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:54,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,895 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:55,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:55,002 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:55,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:55,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:55,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:55,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:55,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:55,104 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:55,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:55,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:55,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:55,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,134 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:55,135 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:55,135 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:55,135 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:55,136 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,136 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,138 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:55,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:55,138 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,139 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,139 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:55,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:55,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:55,145 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:55,145 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:55,145 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:55,197 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f1b2003ca87b45e9a6b7a4b43839efc3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201f1b2003ca87b45e9a6b7a4b43839efc3 2023-03-31 16:53:55,220 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/fdd2d1ea736f4a298c9c7161428449ca 2023-03-31 16:53:55,229 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/fdd2d1ea736f4a298c9c7161428449ca as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca 2023-03-31 16:53:55,240 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca, entries=1, sequenceid=13, filesize=4.9 K 2023-03-31 16:53:55,242 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 97ms, sequenceid=13, compaction requested=true 2023-03-31 16:53:55,242 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:55,242 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:55,251 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:55,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70bc556[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:55,254 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:55,254 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,256 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,256 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:55,260 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:55,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:55,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:55,262 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,262 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:55,262 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:55,262 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:55,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:55,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:55,268 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:55,268 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:55,268 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:55,268 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,268 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:55,271 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,271 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,272 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:55,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:55,273 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,274 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:55,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:55,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:55,279 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:55,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:55,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:55,280 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,281 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,381 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:55,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:55,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:55,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:55,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,398 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:55,398 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:55,398 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:55,398 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:55,399 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,399 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,400 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:55,400 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:55,401 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,401 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:55,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:55,403 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:55,404 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:55,404 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:55,405 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:55,405 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:55,405 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:55,405 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:55,835 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d73cccdd12e548bfba63c2758109c89a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d73cccdd12e548bfba63c2758109c89a 2023-03-31 16:53:55,846 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/a38eec96f38b4e6aafc52bafbf9db10e 2023-03-31 16:53:55,853 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/a38eec96f38b4e6aafc52bafbf9db10e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e 2023-03-31 16:53:55,860 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e, entries=1, sequenceid=17, filesize=4.9 K 2023-03-31 16:53:55,861 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 456ms, sequenceid=17, compaction requested=true 2023-03-31 16:53:55,862 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:55,862 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:55,862 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:55,862 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:55,862 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,862 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:55,862 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:55,864 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:55,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b6b066[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:55,866 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:55,866 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,868 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:55,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:55,868 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:55,869 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,869 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:55,870 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,871 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:55,871 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:55,871 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:55,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:55,879 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:55,879 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:55,879 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:55,879 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,879 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:55,887 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,887 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:55,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,887 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,895 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,896 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,900 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:55,900 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:55,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:55,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:55,901 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,901 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,901 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,901 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:55,901 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:55,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:55,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:55,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:55,903 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:55,903 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:56,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:56,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,014 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,014 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,015 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:56,015 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:56,020 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,020 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,021 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,022 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,022 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,022 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:56,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,024 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:56,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,024 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:56,024 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,025 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:56,032 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:56,032 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:56,032 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,032 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:56,032 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:56,078 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288e042e257a1b4c2f9e9efc1b143450c0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e042e257a1b4c2f9e9efc1b143450c0 2023-03-31 16:53:56,094 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/06888f72ffff4353afaaa64a9060164c 2023-03-31 16:53:56,102 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/06888f72ffff4353afaaa64a9060164c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c 2023-03-31 16:53:56,112 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c, entries=1, sequenceid=21, filesize=4.9 K 2023-03-31 16:53:56,115 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 83ms, sequenceid=21, compaction requested=true 2023-03-31 16:53:56,115 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:56,115 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:56,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:56,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:56,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:56,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,119 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:56,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:56,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@420c9e6e[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:56,123 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:56,123 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,124 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,125 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:56,125 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:56,125 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:56,126 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:56,126 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,126 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:56,129 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:56,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,129 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:56,134 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,134 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,134 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,137 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,139 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,145 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,146 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,146 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,146 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:56,146 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,146 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:56,147 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:56,248 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:56,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:56,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:56,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:56,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,260 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,260 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,261 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:56,261 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:56,262 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,262 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,264 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,264 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,265 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,265 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:56,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,268 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:56,268 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:56,269 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,269 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:56,269 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:56,706 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314c09c9f704804b059bb85607a76c3eac to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314c09c9f704804b059bb85607a76c3eac 2023-03-31 16:53:56,739 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/80cbecc053de4b4eb62e34fcb07fe379 2023-03-31 16:53:56,750 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/80cbecc053de4b4eb62e34fcb07fe379 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379 2023-03-31 16:53:56,761 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379, entries=1, sequenceid=25, filesize=4.9 K 2023-03-31 16:53:56,762 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 493ms, sequenceid=25, compaction requested=true 2023-03-31 16:53:56,762 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:56,762 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,762 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:56,762 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:56,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:56,764 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,764 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,765 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,765 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:56,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:56,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55c6bdb5[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:56,769 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:56,770 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,777 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:56,778 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:56,778 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:56,778 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:56,779 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,779 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,779 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,780 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:56,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:56,785 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:56,785 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:56,785 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:56,785 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,785 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:56,790 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,790 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,790 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,792 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,796 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,798 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,798 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,799 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,799 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:56,800 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:56,801 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:56,901 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:56,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:56,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:56,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:56,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,910 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,910 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,910 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:56,910 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:56,912 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,912 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,914 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,914 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,914 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,914 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,915 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,915 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:56,915 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:56,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:56,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:56,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:56,916 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,917 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:56,917 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:56,949 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e483430201e447d684a2491bd26af381 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e483430201e447d684a2491bd26af381 2023-03-31 16:53:56,955 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/da5569f3fc0d4310967ca878409765cb 2023-03-31 16:53:56,962 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/da5569f3fc0d4310967ca878409765cb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb 2023-03-31 16:53:56,968 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb, entries=1, sequenceid=29, filesize=4.9 K 2023-03-31 16:53:56,970 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 53ms, sequenceid=29, compaction requested=true 2023-03-31 16:53:56,970 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:56,970 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:56,972 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:56,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:56,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cbee32e[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:56,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:56,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,975 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:56,976 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,976 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:56,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:56,977 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:56,981 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:56,981 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:56,981 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:56,981 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,981 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:56,984 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,984 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:56,984 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:56,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,990 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:56,990 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:56,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:56,991 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:56,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:56,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:56,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:56,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:56,993 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:57,093 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:57,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:57,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:57,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:57,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,105 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:57,105 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,106 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:57,106 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:57,106 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,107 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,108 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:57,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:57,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:57,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,110 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:57,110 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:57,115 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:57,115 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,115 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:57,115 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:57,471 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:53:57,538 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c9db27cb069849f6a1204573153200b2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9db27cb069849f6a1204573153200b2 2023-03-31 16:53:57,553 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/e65cc2cb64cf4730af9a78ee1386d0c8 2023-03-31 16:53:57,561 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/e65cc2cb64cf4730af9a78ee1386d0c8 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8 2023-03-31 16:53:57,569 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8, entries=1, sequenceid=33, filesize=4.9 K 2023-03-31 16:53:57,570 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 455ms, sequenceid=33, compaction requested=true 2023-03-31 16:53:57,570 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:57,571 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:57,571 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:57,573 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,573 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,573 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,573 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:57,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c7b575f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:57,575 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:57,575 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,577 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,577 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:57,577 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:57,577 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:57,577 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,577 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:57,581 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:57,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:57,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:57,584 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:57,584 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:57,584 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:57,585 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,585 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:57,588 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,588 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,589 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,589 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,591 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:57,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,598 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:57,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,599 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:57,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:57,600 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:57,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:53:57,700 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:57,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:57,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:57,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:57,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,714 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:57,714 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,715 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:57,715 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:57,715 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,715 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,717 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:57,717 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:57,717 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,717 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,718 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,718 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:57,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,718 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:57,718 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,719 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:57,719 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:57,719 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:57,719 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,719 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:57,719 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:57,737 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090715aff036ade24bfd8d85d0de9f665257 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090715aff036ade24bfd8d85d0de9f665257 2023-03-31 16:53:57,743 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/1f3e64f3a9b24bcbbed02c45275147d7 2023-03-31 16:53:57,749 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/1f3e64f3a9b24bcbbed02c45275147d7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7 2023-03-31 16:53:57,755 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7, entries=1, sequenceid=37, filesize=4.9 K 2023-03-31 16:53:57,756 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 37ms, sequenceid=37, compaction requested=true 2023-03-31 16:53:57,756 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:57,756 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,756 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:57,758 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,758 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,759 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,759 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:57,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aa25950[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:57,761 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:57,761 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,762 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:57,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:57,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:57,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:57,765 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:57,766 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:57,777 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:57,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:57,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:57,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,778 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:57,780 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,780 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:57,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,780 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,781 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,783 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:57,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:57,786 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:57,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:53:57,788 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:57,788 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:57,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:57,888 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:57,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:57,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:53:57,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:53:57,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,899 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:57,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:53:57,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:53:57,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:57,902 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:57,902 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,902 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:53:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:53:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,904 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:53:57,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,904 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:53:57,904 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:53:57,913 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:53:57,913 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:53:57,914 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:53:57,914 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,914 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. started... 2023-03-31 16:53:57,914 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 007079f1db1ff7051238b27d5352ab55 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:53:57,943 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208d37b6c0d5fd45eda3c285d4c8db1a6a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208d37b6c0d5fd45eda3c285d4c8db1a6a 2023-03-31 16:53:57,960 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/5dc5ef4ee5df4b109629174bbc5590ba 2023-03-31 16:53:57,967 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/5dc5ef4ee5df4b109629174bbc5590ba as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba 2023-03-31 16:53:57,979 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba, entries=1, sequenceid=41, filesize=4.9 K 2023-03-31 16:53:57,980 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 007079f1db1ff7051238b27d5352ab55 in 66ms, sequenceid=41, compaction requested=true 2023-03-31 16:53:57,980 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:57,980 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:53:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:53:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:53:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:53:57,983 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,983 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,983 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,983 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:53:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:53:57,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae97ca4[Count = 0] remaining members to acquire global barrier 2023-03-31 16:53:57,985 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:53:57,985 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,987 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:53:57,987 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:53:57,987 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,987 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:53:57,987 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:53:57,989 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,989 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:53:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,989 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:57,989 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:53:57,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:53:57,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:53:57,993 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:53:57,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:53:57,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:53:57,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,993 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:53:57,996 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,996 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,996 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:53:57,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:57,997 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:53:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:57,998 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:53:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:53:58,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:53:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:53:58,001 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:53:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-31 16:53:58,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:53:58,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:53:58,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:53:58,004 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:53:58,004 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:53:58,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:53:58,104 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:53:58,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:53:58,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-31 16:53:58,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:53:58,110 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:53:58,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:53:58,111 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282238111 2023-03-31 16:53:58,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:53:58,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-31 16:53:58,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:53:58,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x53541803 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:53:58,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375e7278, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:53:58,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:53:58,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010396ad1fdd0eeb4eee86cc02f22a48c29d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010396ad1fdd0eeb4eee86cc02f22a48c29d 2023-03-31 16:53:58,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:53:59,001 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:53:59,003 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34982, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:53:59,018 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:53:59,019 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:53:59,049 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8767f8a9165f4d799ce784de39a9d600 first=Optional[r5] last=Optional[r6] 2023-03-31 16:53:59,050 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8767f8a9165f4d799ce784de39a9d600}] 2023-03-31 16:53:59,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8767f8a9165f4d799ce784de39a9d600 for inclusion in 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:59,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-31 16:53:59,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:53:59,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:59,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8767f8a9165f4d799ce784de39a9d600 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__36ah67o92hik34671269nv3di6j61qgknjdu0itb8nbpefe5k3vpbrqj4h9fvfjr/family1/8767f8a9165f4d799ce784de39a9d600 2023-03-31 16:53:59,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__36ah67o92hik34671269nv3di6j61qgknjdu0itb8nbpefe5k3vpbrqj4h9fvfjr/family1/8767f8a9165f4d799ce784de39a9d600 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_ 2023-03-31 16:53:59,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__36ah67o92hik34671269nv3di6j61qgknjdu0itb8nbpefe5k3vpbrqj4h9fvfjr/family1/8767f8a9165f4d799ce784de39a9d600 into 007079f1db1ff7051238b27d5352ab55/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_ - updating store file list. 2023-03-31 16:53:59,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_ into 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:59,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__36ah67o92hik34671269nv3di6j61qgknjdu0itb8nbpefe5k3vpbrqj4h9fvfjr/family1/8767f8a9165f4d799ce784de39a9d600 into 007079f1db1ff7051238b27d5352ab55/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_) 2023-03-31 16:53:59,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__36ah67o92hik34671269nv3di6j61qgknjdu0itb8nbpefe5k3vpbrqj4h9fvfjr/family1/8767f8a9165f4d799ce784de39a9d600 2023-03-31 16:53:59,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:53:59,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:53:59,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 007079f1db1ff7051238b27d5352ab55/family1 is initiating minor compaction 2023-03-31 16:53:59,096 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 007079f1db1ff7051238b27d5352ab55/family1 in testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:59,096 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp, totalSize=49.7 K 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting e820c117bcbd4588a74b3d41a52e627e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting fdd2d1ea736f4a298c9c7161428449ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting a38eec96f38b4e6aafc52bafbf9db10e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting 06888f72ffff4353afaaa64a9060164c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting 80cbecc053de4b4eb62e34fcb07fe379, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting da5569f3fc0d4310967ca878409765cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting e65cc2cb64cf4730af9a78ee1386d0c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting 1f3e64f3a9b24bcbbed02c45275147d7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting 5dc5ef4ee5df4b109629174bbc5590ba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:53:59,097 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting fd86092d39c14be5b3d9e6862680cf54_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:53:59,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@c4f6536; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:59,102 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:53:59,104 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:59,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e483430201e447d684a2491bd26af381 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e483430201e447d684a2491bd26af381 2023-03-31 16:53:59,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9db27cb069849f6a1204573153200b2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9db27cb069849f6a1204573153200b2 2023-03-31 16:53:59,117 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-31 16:53:59,117 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-31 16:53:59,118 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:53:59,118 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:53:59,182 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] throttle.PressureAwareThroughputController(145): 007079f1db1ff7051238b27d5352ab55#family1#compaction#22 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:53:59,224 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/9b39f49d83c34cff85fdd074c27e4095 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/9b39f49d83c34cff85fdd074c27e4095 2023-03-31 16:53:59,232 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 007079f1db1ff7051238b27d5352ab55/family1 of 007079f1db1ff7051238b27d5352ab55 into 9b39f49d83c34cff85fdd074c27e4095(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:53:59,232 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:59,233 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680281639096; duration=0sec 2023-03-31 16:53:59,233 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:59,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_] to archive 2023-03-31 16:53:59,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:59,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e820c117bcbd4588a74b3d41a52e627e 2023-03-31 16:53:59,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fdd2d1ea736f4a298c9c7161428449ca 2023-03-31 16:53:59,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/a38eec96f38b4e6aafc52bafbf9db10e 2023-03-31 16:53:59,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/06888f72ffff4353afaaa64a9060164c 2023-03-31 16:53:59,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/80cbecc053de4b4eb62e34fcb07fe379 2023-03-31 16:53:59,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/da5569f3fc0d4310967ca878409765cb 2023-03-31 16:53:59,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/e65cc2cb64cf4730af9a78ee1386d0c8 2023-03-31 16:53:59,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/1f3e64f3a9b24bcbbed02c45275147d7 2023-03-31 16:53:59,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/5dc5ef4ee5df4b109629174bbc5590ba 2023-03-31 16:53:59,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/fd86092d39c14be5b3d9e6862680cf54_SeqId_44_ 2023-03-31 16:53:59,619 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317d971eda83614cb89012130071a43e0a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317d971eda83614cb89012130071a43e0a 2023-03-31 16:53:59,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:53:59,656 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/56c87c0d5d3541608a9d6b92b6fb86ba first=Optional[r1] last=Optional[r4] 2023-03-31 16:53:59,657 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/56c87c0d5d3541608a9d6b92b6fb86ba}] 2023-03-31 16:53:59,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/56c87c0d5d3541608a9d6b92b6fb86ba for inclusion in 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:59,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-31 16:53:59,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:53:59,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:53:59,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/56c87c0d5d3541608a9d6b92b6fb86ba to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tg1kk6rcakltjheh57srk8n1so9b63torsd4mq3i0vlm6udt5p5g3b9ltnijhb0a/family1/56c87c0d5d3541608a9d6b92b6fb86ba 2023-03-31 16:53:59,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tg1kk6rcakltjheh57srk8n1so9b63torsd4mq3i0vlm6udt5p5g3b9ltnijhb0a/family1/56c87c0d5d3541608a9d6b92b6fb86ba as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_ 2023-03-31 16:53:59,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tg1kk6rcakltjheh57srk8n1so9b63torsd4mq3i0vlm6udt5p5g3b9ltnijhb0a/family1/56c87c0d5d3541608a9d6b92b6fb86ba into 007079f1db1ff7051238b27d5352ab55/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_ - updating store file list. 2023-03-31 16:53:59,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_ into 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:53:59,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tg1kk6rcakltjheh57srk8n1so9b63torsd4mq3i0vlm6udt5p5g3b9ltnijhb0a/family1/56c87c0d5d3541608a9d6b92b6fb86ba into 007079f1db1ff7051238b27d5352ab55/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_) 2023-03-31 16:53:59,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tg1kk6rcakltjheh57srk8n1so9b63torsd4mq3i0vlm6udt5p5g3b9ltnijhb0a/family1/56c87c0d5d3541608a9d6b92b6fb86ba 2023-03-31 16:53:59,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:53:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:53:59,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 007079f1db1ff7051238b27d5352ab55/family1 is initiating minor compaction (all files) 2023-03-31 16:53:59,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5ec2bf8d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:53:59,686 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 007079f1db1ff7051238b27d5352ab55/family1 in testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:53:59,686 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/9b39f49d83c34cff85fdd074c27e4095, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp, totalSize=178.1 K 2023-03-31 16:53:59,691 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 8c88da9b58334c9ea1ee9b3ddc028f63, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:53:59,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:53:59,692 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 9b39f49d83c34cff85fdd074c27e4095, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:53:59,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:53:59,693 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242768 2023-03-31 16:53:59,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201f1b2003ca87b45e9a6b7a4b43839efc3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201f1b2003ca87b45e9a6b7a4b43839efc3 2023-03-31 16:53:59,700 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d73cccdd12e548bfba63c2758109c89a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d73cccdd12e548bfba63c2758109c89a 2023-03-31 16:53:59,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e042e257a1b4c2f9e9efc1b143450c0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288e042e257a1b4c2f9e9efc1b143450c0 2023-03-31 16:53:59,705 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314c09c9f704804b059bb85607a76c3eac to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314c09c9f704804b059bb85607a76c3eac 2023-03-31 16:53:59,705 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-31 16:53:59,705 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-31 16:53:59,705 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:53:59,705 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:53:59,727 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 007079f1db1ff7051238b27d5352ab55#family1#compaction#23 average throughput is 9.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:00,193 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130237f952378154ba389d5f8e839ae23d4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130237f952378154ba389d5f8e839ae23d4 2023-03-31 16:54:00,195 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/.tmp/family1/8320df7c72e9402b96de40d45d231430 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8320df7c72e9402b96de40d45d231430 2023-03-31 16:54:00,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:54:00,213 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 007079f1db1ff7051238b27d5352ab55/family1 of 007079f1db1ff7051238b27d5352ab55 into 8320df7c72e9402b96de40d45d231430(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:00,213 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:54:00,214 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1680281639686; duration=0sec 2023-03-31 16:54:00,214 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:00,237 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ee703f454bec4998a59818fe4a57aca0 first=Optional[r00] last=Optional[r8] 2023-03-31 16:54:00,238 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ee703f454bec4998a59818fe4a57aca0}] 2023-03-31 16:54:00,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ee703f454bec4998a59818fe4a57aca0 for inclusion in 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:54:00,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-31 16:54:00,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:00,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:54:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ee703f454bec4998a59818fe4a57aca0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u5gnp7danv7nljkbgnbmt18td6u25qb60fv6u8uq1nfkh75boe6b91gi0o75uqc8/family1/ee703f454bec4998a59818fe4a57aca0 2023-03-31 16:54:00,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u5gnp7danv7nljkbgnbmt18td6u25qb60fv6u8uq1nfkh75boe6b91gi0o75uqc8/family1/ee703f454bec4998a59818fe4a57aca0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/c300e86c453449648beff87ffad2fa81_SeqId_50_ 2023-03-31 16:54:00,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u5gnp7danv7nljkbgnbmt18td6u25qb60fv6u8uq1nfkh75boe6b91gi0o75uqc8/family1/ee703f454bec4998a59818fe4a57aca0 into 007079f1db1ff7051238b27d5352ab55/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/c300e86c453449648beff87ffad2fa81_SeqId_50_ - updating store file list. 2023-03-31 16:54:00,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/c300e86c453449648beff87ffad2fa81_SeqId_50_ into 007079f1db1ff7051238b27d5352ab55/family1 2023-03-31 16:54:00,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u5gnp7danv7nljkbgnbmt18td6u25qb60fv6u8uq1nfkh75boe6b91gi0o75uqc8/family1/ee703f454bec4998a59818fe4a57aca0 into 007079f1db1ff7051238b27d5352ab55/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/c300e86c453449648beff87ffad2fa81_SeqId_50_) 2023-03-31 16:54:00,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u5gnp7danv7nljkbgnbmt18td6u25qb60fv6u8uq1nfkh75boe6b91gi0o75uqc8/family1/ee703f454bec4998a59818fe4a57aca0 2023-03-31 16:54:00,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:54:00,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:00,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208d37b6c0d5fd45eda3c285d4c8db1a6a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208d37b6c0d5fd45eda3c285d4c8db1a6a 2023-03-31 16:54:00,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128fba5f6740f724e2ab0eaf98c21118378 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128fba5f6740f724e2ab0eaf98c21118378 2023-03-31 16:54:00,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130448d81aecde9450da2e0c0d84d9ab940 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130448d81aecde9450da2e0c0d84d9ab940 2023-03-31 16:54:00,266 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-31 16:54:00,266 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-31 16:54:00,266 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:54:00,266 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:54:00,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:54:00,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:54:00,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:00,268 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:00,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.1600 sec 2023-03-31 16:54:00,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/9b39f49d83c34cff85fdd074c27e4095, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_] to archive 2023-03-31 16:54:00,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:00,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/8c88da9b58334c9ea1ee9b3ddc028f63 2023-03-31 16:54:00,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/9b39f49d83c34cff85fdd074c27e4095 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/9b39f49d83c34cff85fdd074c27e4095 2023-03-31 16:54:00,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/family1/ae444dd6bb3e41dc8081743b6e44e7b9_SeqId_47_ 2023-03-31 16:54:00,433 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 253) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45330 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48686 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48680 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48722 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48784 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1133b69-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45512 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48794 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48804 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48806 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48814 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x53541803-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x4049c75-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x53541803 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1808081689.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48666 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48762 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1133b69-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48636 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1704487208_15 at /127.0.0.1:48748 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:45426 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57785@0x53541803-SendThread(127.0.0.1:57785) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-87482557_15 at /127.0.0.1:48840 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4049c75-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1704487208_15 at /127.0.0.1:45372 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=628 (was 598) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 353) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3867 (was 4069) 2023-03-31 16:54:00,451 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=630, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=169, AvailableMemoryMB=3864 2023-03-31 16:54:00,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:54:00,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:00,461 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:00,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:00,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-31 16:54:00,464 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:00,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5 empty. 2023-03-31 16:54:00,466 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:00,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-31 16:54:00,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-31 16:54:00,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-31 16:54:00,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-31 16:54:00,894 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:00,896 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b42dcbfa58e1735b1bbec166cd317b5, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:00,902 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:00,902 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 8b42dcbfa58e1735b1bbec166cd317b5, disabling compactions & flushes 2023-03-31 16:54:00,903 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:00,903 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:00,903 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. after waiting 0 ms 2023-03-31 16:54:00,903 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:00,903 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:00,903 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:00,906 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:00,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281640907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281640907"}]},"ts":"1680281640907"} 2023-03-31 16:54:00,909 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:54:00,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:00,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281640910"}]},"ts":"1680281640910"} 2023-03-31 16:54:00,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-31 16:54:00,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8b42dcbfa58e1735b1bbec166cd317b5, ASSIGN}] 2023-03-31 16:54:00,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8b42dcbfa58e1735b1bbec166cd317b5, ASSIGN 2023-03-31 16:54:00,925 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8b42dcbfa58e1735b1bbec166cd317b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:01,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-31 16:54:01,076 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8b42dcbfa58e1735b1bbec166cd317b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,077 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281641076"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281641076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281641076"}]},"ts":"1680281641076"} 2023-03-31 16:54:01,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 8b42dcbfa58e1735b1bbec166cd317b5, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:01,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b42dcbfa58e1735b1bbec166cd317b5, NAME => 'testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,263 INFO [StoreOpener-8b42dcbfa58e1735b1bbec166cd317b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,263 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:01,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x185e2a96 to 127.0.0.1:57785 2023-03-31 16:54:01,264 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:01,265 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:01,265 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68f806a8 to 127.0.0.1:57785 2023-03-31 16:54:01,265 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:01,265 DEBUG [StoreOpener-8b42dcbfa58e1735b1bbec166cd317b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:01,265 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:01,265 DEBUG [StoreOpener-8b42dcbfa58e1735b1bbec166cd317b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:01,267 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53541803 to 127.0.0.1:57785 2023-03-31 16:54:01,267 INFO [StoreOpener-8b42dcbfa58e1735b1bbec166cd317b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b42dcbfa58e1735b1bbec166cd317b5 columnFamilyName family1 2023-03-31 16:54:01,267 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:01,270 INFO [StoreOpener-8b42dcbfa58e1735b1bbec166cd317b5-1] regionserver.HStore(310): Store=8b42dcbfa58e1735b1bbec166cd317b5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:01,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:54:01,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:01,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b42dcbfa58e1735b1bbec166cd317b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62753025, jitterRate=-0.06490705907344818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:01,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:01,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5., pid=25, masterSystemTime=1680281641232 2023-03-31 16:54:01,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8b42dcbfa58e1735b1bbec166cd317b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,282 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281641281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281641281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281641281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281641281"}]},"ts":"1680281641281"} 2023-03-31 16:54:01,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-31 16:54:01,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 8b42dcbfa58e1735b1bbec166cd317b5, server=jenkins-hbase4.apache.org,41157,1680281619369 in 204 msec 2023-03-31 16:54:01,287 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-31 16:54:01,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8b42dcbfa58e1735b1bbec166cd317b5, ASSIGN in 363 msec 2023-03-31 16:54:01,288 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:01,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281641288"}]},"ts":"1680281641288"} 2023-03-31 16:54:01,290 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-31 16:54:01,472 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:01,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.0160 sec 2023-03-31 16:54:01,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-31 16:54:01,578 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-31 16:54:01,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:01,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,670 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:01,670 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:01,670 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:01,670 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:01,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,672 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,674 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:01,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:01,674 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,675 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,675 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:01,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,676 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:01,676 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:01,676 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:01,677 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:01,677 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:01,677 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,677 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:01,680 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:54:01,720 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b31b1719b7304c348186a821800975b5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130b31b1719b7304c348186a821800975b5 2023-03-31 16:54:01,726 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b6449fb5821a470b9ab076197867fcae 2023-03-31 16:54:01,734 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b6449fb5821a470b9ab076197867fcae as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b6449fb5821a470b9ab076197867fcae 2023-03-31 16:54:01,743 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b6449fb5821a470b9ab076197867fcae, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-31 16:54:01,745 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 65ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:01,746 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:01,746 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:01,747 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,747 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:01,747 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:01,747 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,747 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:01,747 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:01,749 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,750 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,750 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:01,751 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:01,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b55f44[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:01,754 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:01,754 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,755 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:01,756 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:01,756 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:01,756 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,756 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:01,758 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:01,763 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:01,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:01,764 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:01,764 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,764 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:01,766 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,766 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,766 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:01,767 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,769 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:01,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:01,773 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:01,774 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:01,774 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:01,774 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,774 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,774 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:01,774 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:01,875 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:01,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:01,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:01,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:01,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,894 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:01,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:01,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:01,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:01,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,894 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:01,900 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:01,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,902 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:01,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,902 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:01,902 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:01,902 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:01,908 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:01,908 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:01,908 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,908 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:01,908 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:54:01,929 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128da47dee3089a45dbac7f533b87d6e75f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128da47dee3089a45dbac7f533b87d6e75f 2023-03-31 16:54:01,942 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b931e0a3f1a44e549c2c3e79d92b8aef 2023-03-31 16:54:01,949 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b931e0a3f1a44e549c2c3e79d92b8aef as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef 2023-03-31 16:54:01,955 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:54:01,956 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 48ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:01,956 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:01,956 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:01,957 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:01,958 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,958 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67523982[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:01,961 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:01,961 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,964 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,964 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:01,964 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:01,972 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,972 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:01,975 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:01,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:01,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:01,975 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,976 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:01,978 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,978 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:01,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,978 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:01,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:01,979 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,980 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,987 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:01,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:01,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:01,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:01,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:01,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:01,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:01,988 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:01,988 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:01,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:01,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:02,089 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:02,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:02,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:02,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,099 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:02,099 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,100 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,102 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:02,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:02,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:02,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:02,104 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:02,104 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:02,104 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:02,129 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013ea15579f14e4024b8402b4fda6c51c3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013ea15579f14e4024b8402b4fda6c51c3 2023-03-31 16:54:02,136 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b44a67819cf44bb79fc7a31d160a5e75 2023-03-31 16:54:02,143 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/b44a67819cf44bb79fc7a31d160a5e75 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75 2023-03-31 16:54:02,152 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75, entries=1, sequenceid=13, filesize=4.9 K 2023-03-31 16:54:02,153 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 49ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:02,154 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:02,154 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:02,154 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:02,154 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:02,154 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,154 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:02,154 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:02,156 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,156 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,156 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,156 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:02,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:02,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ff284e1[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:02,159 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:02,159 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,160 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,160 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:02,161 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:02,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:02,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:02,163 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:02,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:02,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:02,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:02,167 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:02,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:02,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:02,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,167 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:02,172 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,173 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:02,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:02,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,174 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,177 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,181 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,183 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:02,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:02,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:02,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:02,183 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:02,183 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:02,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:02,184 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:02,184 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:02,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:02,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:02,284 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:02,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:02,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:02,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:02,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,294 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:02,294 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,294 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:02,294 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:02,294 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,295 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,296 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:02,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:02,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:02,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:02,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:02,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,297 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:02,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,300 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:02,300 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,300 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:02,300 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:02,300 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:02,300 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:02,300 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:02,301 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:02,734 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e7ece6ab5b2c4cd5840007e2153d7a4e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e7ece6ab5b2c4cd5840007e2153d7a4e 2023-03-31 16:54:02,742 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/ed1b1f386f184475928cbb80e8be5ce3 2023-03-31 16:54:02,751 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/ed1b1f386f184475928cbb80e8be5ce3 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3 2023-03-31 16:54:02,759 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3, entries=1, sequenceid=17, filesize=4.9 K 2023-03-31 16:54:02,760 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 460ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:02,760 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:02,760 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:02,763 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:02,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e0fc1e7[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:02,765 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:02,765 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,767 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:02,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:02,767 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,767 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:02,768 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,768 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:02,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:02,772 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:02,772 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:02,772 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:02,772 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,772 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:02,775 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,775 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:02,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,775 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:02,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,776 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,778 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,783 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,783 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:02,783 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:02,783 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:02,783 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:02,783 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:02,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:02,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:02,784 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:02,884 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:02,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:02,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,895 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:02,895 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,895 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:02,895 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:02,896 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,896 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,898 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:02,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:02,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:02,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,900 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,900 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:02,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:02,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:02,900 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:02,900 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:02,901 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:02,921 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122823573b03f8c04ab4bd6a4910f8fe981d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122823573b03f8c04ab4bd6a4910f8fe981d 2023-03-31 16:54:03,331 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/77dd86f896ee4cfe98803e14ae5f5989 2023-03-31 16:54:03,338 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/77dd86f896ee4cfe98803e14ae5f5989 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989 2023-03-31 16:54:03,344 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989, entries=1, sequenceid=21, filesize=4.9 K 2023-03-31 16:54:03,345 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 444ms, sequenceid=21, compaction requested=true 2023-03-31 16:54:03,346 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:03,346 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:03,346 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:03,346 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:03,346 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,346 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:03,346 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:03,350 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,350 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,350 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,351 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35abfa1d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:03,352 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:03,353 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,354 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,354 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:03,354 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:03,354 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:03,354 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,354 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:03,355 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:03,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:03,358 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:03,358 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:03,358 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:03,358 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,358 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:03,361 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,361 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,362 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:03,362 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,363 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:03,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,366 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:03,366 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:03,367 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:03,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:03,367 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:03,367 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:03,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:03,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:03,467 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:03,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:03,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:03,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:03,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,475 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:03,475 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:03,475 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:03,475 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:03,476 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,476 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,477 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:03,477 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:03,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:03,477 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,478 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:03,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,479 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:03,479 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:03,479 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:03,480 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:03,480 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:03,480 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:03,480 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:03,480 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:03,896 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312856043e15f74faa8c9473680970ab00 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312856043e15f74faa8c9473680970ab00 2023-03-31 16:54:03,907 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/26f37b10cccb469e98ddc23de1449bf7 2023-03-31 16:54:03,914 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/26f37b10cccb469e98ddc23de1449bf7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7 2023-03-31 16:54:03,919 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7, entries=1, sequenceid=25, filesize=4.9 K 2023-03-31 16:54:03,920 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 440ms, sequenceid=25, compaction requested=true 2023-03-31 16:54:03,920 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:03,920 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:03,920 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:03,920 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:03,929 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,929 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,929 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,929 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43c35b03[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:03,931 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:03,931 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,932 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:03,933 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,934 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:03,938 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:03,938 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:03,941 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:03,941 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:03,941 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:03,941 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,942 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:03,943 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,943 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:03,943 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:03,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:03,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:03,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,946 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,948 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:03,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:03,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:03,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:03,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:03,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:03,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:03,949 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:03,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:04,049 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:04,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:04,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:04,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,058 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:04,058 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,059 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:04,059 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:04,059 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,059 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,060 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,060 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:04,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:04,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,062 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,062 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:04,062 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,063 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:04,063 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:04,063 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:04,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:04,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:04,063 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:04,090 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101faba4d7bd5774dbab966bb8a746f6485 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101faba4d7bd5774dbab966bb8a746f6485 2023-03-31 16:54:04,098 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/37a927b8e7fb471dbfeb41df178b5334 2023-03-31 16:54:04,106 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/37a927b8e7fb471dbfeb41df178b5334 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334 2023-03-31 16:54:04,111 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334, entries=1, sequenceid=29, filesize=4.9 K 2023-03-31 16:54:04,112 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 49ms, sequenceid=29, compaction requested=true 2023-03-31 16:54:04,112 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:04,112 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:04,113 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:04,113 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:04,113 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,113 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:04,113 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:04,116 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,116 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,116 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,116 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:04,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:04,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@782d0a16[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:04,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:04,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,119 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:04,119 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,120 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:04,121 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,121 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:04,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,121 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:04,121 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:04,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:04,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:04,125 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:04,125 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:04,125 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:04,125 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,125 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:04,127 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,127 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,127 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:04,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:04,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:04,128 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,139 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,143 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:04,143 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:04,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:04,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:04,144 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:04,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:04,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:04,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:04,144 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:04,245 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:04,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:04,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,252 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:04,252 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,252 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:04,252 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:04,253 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,253 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,254 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:04,254 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:04,255 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,255 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:04,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:04,256 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:04,257 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:04,257 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:04,278 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010355e84b965fcd475c8c49e29a71a3816e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010355e84b965fcd475c8c49e29a71a3816e 2023-03-31 16:54:04,686 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/bb44bfaa739f48bba84cb6f9ffe498d7 2023-03-31 16:54:04,691 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/bb44bfaa739f48bba84cb6f9ffe498d7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7 2023-03-31 16:54:04,696 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7, entries=1, sequenceid=33, filesize=4.9 K 2023-03-31 16:54:04,697 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 440ms, sequenceid=33, compaction requested=true 2023-03-31 16:54:04,697 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:04,697 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:04,699 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:04,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@580dfc0d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:04,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:04,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:04,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:04,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:04,703 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,703 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:04,705 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,705 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,705 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,705 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:04,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:04,708 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:04,708 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:04,708 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:04,708 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,708 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:04,710 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,710 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,710 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:04,710 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,712 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:04,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:04,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:04,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:04,715 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:04,715 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:04,815 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:04,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:04,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,823 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:04,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:04,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:04,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,825 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:04,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:04,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:04,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,826 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,826 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:04,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:04,826 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:04,827 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:04,827 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:04,827 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:04,842 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090729a2dbb290814094a9211103fcd48666 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090729a2dbb290814094a9211103fcd48666 2023-03-31 16:54:05,247 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/9692ed4050654ff8a8d7f92c0334da0f 2023-03-31 16:54:05,253 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/9692ed4050654ff8a8d7f92c0334da0f as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f 2023-03-31 16:54:05,259 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f, entries=1, sequenceid=37, filesize=4.9 K 2023-03-31 16:54:05,260 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 433ms, sequenceid=37, compaction requested=true 2023-03-31 16:54:05,260 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:05,260 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:05,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:05,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:05,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:05,260 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:05,263 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@329c9e03[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:05,265 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:05,265 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,269 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:05,269 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,269 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:05,271 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,271 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,271 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:05,271 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:05,273 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:05,273 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:05,273 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:05,273 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,273 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:05,276 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,276 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:05,276 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:05,276 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,277 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:05,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:05,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,279 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:05,279 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,280 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,280 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,280 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:05,280 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:05,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:05,380 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:05,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:05,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,387 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:05,387 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:05,387 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:05,387 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:05,387 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,387 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,389 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,389 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:05,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:05,389 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:05,389 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:05,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:05,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,390 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:05,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:05,390 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:05,390 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:05,390 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. started... 2023-03-31 16:54:05,391 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b42dcbfa58e1735b1bbec166cd317b5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:05,803 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120cd2f3edb92bb4fe09b5594d9ae12141d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120cd2f3edb92bb4fe09b5594d9ae12141d 2023-03-31 16:54:06,209 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/35452852a76c4a218c43c24444a54143 2023-03-31 16:54:06,215 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/35452852a76c4a218c43c24444a54143 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143 2023-03-31 16:54:06,219 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143, entries=1, sequenceid=41, filesize=4.9 K 2023-03-31 16:54:06,220 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8b42dcbfa58e1735b1bbec166cd317b5 in 829ms, sequenceid=41, compaction requested=true 2023-03-31 16:54:06,220 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:06,220 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:06,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,223 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bded010[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:06,224 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:06,224 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,225 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:06,225 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,225 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:06,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:06,227 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:06,227 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,227 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:06,228 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:06,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:06,230 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:06,230 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:06,230 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:06,230 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,230 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:06,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:06,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:06,232 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:06,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:06,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-31 16:54:06,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,235 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:06,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:06,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,235 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:06,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:06,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:06,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:06,236 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:06,336 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:06,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:06,338 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-31 16:54:06,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:06,341 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:06,341 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282246341 2023-03-31 16:54:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:54:06,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-31 16:54:06,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x40a1250d to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:06,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a842d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:06,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,739 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:06,792 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039750539e172245bf9a3f550a6d72f08e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601039750539e172245bf9a3f550a6d72f08e 2023-03-31 16:54:06,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,806 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:06,807 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35210, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:06,814 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:06,815 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:06,824 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/27c4c7120a9e426bb0e01e2ff0600f9b first=Optional[r3] last=Optional[r6] 2023-03-31 16:54:06,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/27c4c7120a9e426bb0e01e2ff0600f9b}] 2023-03-31 16:54:06,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/27c4c7120a9e426bb0e01e2ff0600f9b for inclusion in 8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:06,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-31 16:54:06,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:06,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:06,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/27c4c7120a9e426bb0e01e2ff0600f9b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__qm9q9fil8b3sk498u7ktifd90i94gaduui5q49okcn2dbstd8gc3ppcios14nqur/family1/27c4c7120a9e426bb0e01e2ff0600f9b 2023-03-31 16:54:06,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__qm9q9fil8b3sk498u7ktifd90i94gaduui5q49okcn2dbstd8gc3ppcios14nqur/family1/27c4c7120a9e426bb0e01e2ff0600f9b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_ 2023-03-31 16:54:06,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__qm9q9fil8b3sk498u7ktifd90i94gaduui5q49okcn2dbstd8gc3ppcios14nqur/family1/27c4c7120a9e426bb0e01e2ff0600f9b into 8b42dcbfa58e1735b1bbec166cd317b5/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_ - updating store file list. 2023-03-31 16:54:06,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_ into 8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:06,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__qm9q9fil8b3sk498u7ktifd90i94gaduui5q49okcn2dbstd8gc3ppcios14nqur/family1/27c4c7120a9e426bb0e01e2ff0600f9b into 8b42dcbfa58e1735b1bbec166cd317b5/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_) 2023-03-31 16:54:06,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__qm9q9fil8b3sk498u7ktifd90i94gaduui5q49okcn2dbstd8gc3ppcios14nqur/family1/27c4c7120a9e426bb0e01e2ff0600f9b 2023-03-31 16:54:06,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:54:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:54:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 8b42dcbfa58e1735b1bbec166cd317b5/family1 is initiating minor compaction 2023-03-31 16:54:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@67cf2aa3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:06,843 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8b42dcbfa58e1735b1bbec166cd317b5/family1 in testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:54:06,844 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp, totalSize=50.0 K 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting b931e0a3f1a44e549c2c3e79d92b8aef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting b44a67819cf44bb79fc7a31d160a5e75, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting ed1b1f386f184475928cbb80e8be5ce3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 77dd86f896ee4cfe98803e14ae5f5989, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 26f37b10cccb469e98ddc23de1449bf7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 37a927b8e7fb471dbfeb41df178b5334, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting bb44bfaa739f48bba84cb6f9ffe498d7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 9692ed4050654ff8a8d7f92c0334da0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:54:06,844 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 35452852a76c4a218c43c24444a54143, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:54:06,845 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 52f844eae71a44709f870c1661675233_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:54:06,845 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:06,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122823573b03f8c04ab4bd6a4910f8fe981d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122823573b03f8c04ab4bd6a4910f8fe981d 2023-03-31 16:54:06,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312856043e15f74faa8c9473680970ab00 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312856043e15f74faa8c9473680970ab00 2023-03-31 16:54:06,851 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101faba4d7bd5774dbab966bb8a746f6485 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101faba4d7bd5774dbab966bb8a746f6485 2023-03-31 16:54:06,852 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010355e84b965fcd475c8c49e29a71a3816e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010355e84b965fcd475c8c49e29a71a3816e 2023-03-31 16:54:06,852 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-31 16:54:06,852 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-31 16:54:06,852 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,880 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8b42dcbfa58e1735b1bbec166cd317b5#family1#compaction#34 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:06,891 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ab3e84050b04472d854c059d5704485c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ab3e84050b04472d854c059d5704485c 2023-03-31 16:54:06,892 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,917 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/00d330e89aaa4c21beb64d5bdd4075f4 first=Optional[r1] last=Optional[r2] 2023-03-31 16:54:06,917 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/00d330e89aaa4c21beb64d5bdd4075f4}] 2023-03-31 16:54:06,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/00d330e89aaa4c21beb64d5bdd4075f4 for inclusion in 8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-31 16:54:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:06,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/00d330e89aaa4c21beb64d5bdd4075f4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ou12snioi6bem7i9v3q9l12f9fkb43od8ktasjif5455j3veh05gj4m3de6drkj9/family1/00d330e89aaa4c21beb64d5bdd4075f4 2023-03-31 16:54:06,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ou12snioi6bem7i9v3q9l12f9fkb43od8ktasjif5455j3veh05gj4m3de6drkj9/family1/00d330e89aaa4c21beb64d5bdd4075f4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/5ae47a9fadfd45409badb3bc6a77024d_SeqId_46_ 2023-03-31 16:54:06,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ou12snioi6bem7i9v3q9l12f9fkb43od8ktasjif5455j3veh05gj4m3de6drkj9/family1/00d330e89aaa4c21beb64d5bdd4075f4 into 8b42dcbfa58e1735b1bbec166cd317b5/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/5ae47a9fadfd45409badb3bc6a77024d_SeqId_46_ - updating store file list. 2023-03-31 16:54:06,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/5ae47a9fadfd45409badb3bc6a77024d_SeqId_46_ into 8b42dcbfa58e1735b1bbec166cd317b5/family1 2023-03-31 16:54:06,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ou12snioi6bem7i9v3q9l12f9fkb43od8ktasjif5455j3veh05gj4m3de6drkj9/family1/00d330e89aaa4c21beb64d5bdd4075f4 into 8b42dcbfa58e1735b1bbec166cd317b5/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/5ae47a9fadfd45409badb3bc6a77024d_SeqId_46_) 2023-03-31 16:54:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ou12snioi6bem7i9v3q9l12f9fkb43od8ktasjif5455j3veh05gj4m3de6drkj9/family1/00d330e89aaa4c21beb64d5bdd4075f4 2023-03-31 16:54:06,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:06,935 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013ea15579f14e4024b8402b4fda6c51c3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013ea15579f14e4024b8402b4fda6c51c3 2023-03-31 16:54:06,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e7ece6ab5b2c4cd5840007e2153d7a4e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e7ece6ab5b2c4cd5840007e2153d7a4e 2023-03-31 16:54:06,936 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-31 16:54:06,937 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-31 16:54:06,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:06,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:06,939 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:06,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 600 msec 2023-03-31 16:54:07,036 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262 (was 258) - Thread LEAK? -, OpenFileDescriptor=632 (was 630) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 403), ProcessCount=169 (was 169), AvailableMemoryMB=3812 (was 3864) 2023-03-31 16:54:07,046 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=262, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=169, AvailableMemoryMB=3812 2023-03-31 16:54:07,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-31 16:54:07,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:07,051 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:07,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-31 16:54:07,052 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:07,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098 empty. 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc empty. 2023-03-31 16:54:07,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6 empty. 2023-03-31 16:54:07,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:07,055 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:07,055 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:07,055 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-31 16:54:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:07,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:07,466 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:07,468 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 57a0c62f5ac9e62580d0ef1c0c3118f6, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:07,468 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea65ff07c2e9369016f64da014f99098, NAME => 'testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:07,468 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a6bc2c65d66d97bc6535fe98d1f8cfc, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:07,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:07,696 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/.tmp/family1/c5e2b4a2aaa54cb3b31949a7b5766b6e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/c5e2b4a2aaa54cb3b31949a7b5766b6e 2023-03-31 16:54:07,701 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8b42dcbfa58e1735b1bbec166cd317b5/family1 of 8b42dcbfa58e1735b1bbec166cd317b5 into c5e2b4a2aaa54cb3b31949a7b5766b6e(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:07,701 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:54:07,701 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680281646843; duration=0sec 2023-03-31 16:54:07,701 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:07,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_] to archive 2023-03-31 16:54:07,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:07,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b931e0a3f1a44e549c2c3e79d92b8aef 2023-03-31 16:54:07,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/b44a67819cf44bb79fc7a31d160a5e75 2023-03-31 16:54:07,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/ed1b1f386f184475928cbb80e8be5ce3 2023-03-31 16:54:07,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/77dd86f896ee4cfe98803e14ae5f5989 2023-03-31 16:54:07,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/26f37b10cccb469e98ddc23de1449bf7 2023-03-31 16:54:07,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/37a927b8e7fb471dbfeb41df178b5334 2023-03-31 16:54:07,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/bb44bfaa739f48bba84cb6f9ffe498d7 2023-03-31 16:54:07,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/9692ed4050654ff8a8d7f92c0334da0f 2023-03-31 16:54:07,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/35452852a76c4a218c43c24444a54143 2023-03-31 16:54:07,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/family1/52f844eae71a44709f870c1661675233_SeqId_44_ 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing ea65ff07c2e9369016f64da014f99098, disabling compactions & flushes 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 8a6bc2c65d66d97bc6535fe98d1f8cfc, disabling compactions & flushes 2023-03-31 16:54:07,883 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:07,883 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 57a0c62f5ac9e62580d0ef1c0c3118f6, disabling compactions & flushes 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:07,883 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. after waiting 0 ms 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. after waiting 0 ms 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:07,884 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:07,884 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:07,884 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 8a6bc2c65d66d97bc6535fe98d1f8cfc: 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. after waiting 0 ms 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for ea65ff07c2e9369016f64da014f99098: 2023-03-31 16:54:07,884 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:07,884 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:07,886 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:07,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680281647887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281647887"}]},"ts":"1680281647887"} 2023-03-31 16:54:07,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281647887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281647887"}]},"ts":"1680281647887"} 2023-03-31 16:54:07,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281647887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281647887"}]},"ts":"1680281647887"} 2023-03-31 16:54:07,890 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-31 16:54:07,891 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:07,891 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281647891"}]},"ts":"1680281647891"} 2023-03-31 16:54:07,892 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-31 16:54:07,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ea65ff07c2e9369016f64da014f99098, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8a6bc2c65d66d97bc6535fe98d1f8cfc, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57a0c62f5ac9e62580d0ef1c0c3118f6, ASSIGN}] 2023-03-31 16:54:07,898 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ea65ff07c2e9369016f64da014f99098, ASSIGN 2023-03-31 16:54:07,898 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8a6bc2c65d66d97bc6535fe98d1f8cfc, ASSIGN 2023-03-31 16:54:07,898 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57a0c62f5ac9e62580d0ef1c0c3118f6, ASSIGN 2023-03-31 16:54:07,898 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ea65ff07c2e9369016f64da014f99098, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:07,898 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57a0c62f5ac9e62580d0ef1c0c3118f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:07,898 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8a6bc2c65d66d97bc6535fe98d1f8cfc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:08,050 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ea65ff07c2e9369016f64da014f99098, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,050 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=57a0c62f5ac9e62580d0ef1c0c3118f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,050 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8a6bc2c65d66d97bc6535fe98d1f8cfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,050 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281648050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281648050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281648050"}]},"ts":"1680281648050"} 2023-03-31 16:54:08,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281648050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281648050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281648050"}]},"ts":"1680281648050"} 2023-03-31 16:54:08,051 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680281648050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281648050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281648050"}]},"ts":"1680281648050"} 2023-03-31 16:54:08,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure ea65ff07c2e9369016f64da014f99098, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:08,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 57a0c62f5ac9e62580d0ef1c0c3118f6, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:08,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 8a6bc2c65d66d97bc6535fe98d1f8cfc, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:08,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:08,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:08,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57a0c62f5ac9e62580d0ef1c0c3118f6, NAME => 'testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.', STARTKEY => '2', ENDKEY => ''} 2023-03-31 16:54:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,209 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,210 DEBUG [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1 2023-03-31 16:54:08,211 DEBUG [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1 2023-03-31 16:54:08,211 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57a0c62f5ac9e62580d0ef1c0c3118f6 columnFamilyName family1 2023-03-31 16:54:08,213 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] regionserver.HStore(310): Store=57a0c62f5ac9e62580d0ef1c0c3118f6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,213 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,214 DEBUG [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family2 2023-03-31 16:54:08,214 DEBUG [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family2 2023-03-31 16:54:08,215 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57a0c62f5ac9e62580d0ef1c0c3118f6 columnFamilyName family2 2023-03-31 16:54:08,216 INFO [StoreOpener-57a0c62f5ac9e62580d0ef1c0c3118f6-1] regionserver.HStore(310): Store=57a0c62f5ac9e62580d0ef1c0c3118f6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:08,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:54:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:08,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 57a0c62f5ac9e62580d0ef1c0c3118f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62423949, jitterRate=-0.06981067359447479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:08,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6., pid=32, masterSystemTime=1680281648204 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a6bc2c65d66d97bc6535fe98d1f8cfc, NAME => 'testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.', STARTKEY => '1', ENDKEY => '2'} 2023-03-31 16:54:08,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=57a0c62f5ac9e62580d0ef1c0c3118f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:08,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281648226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281648226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281648226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281648226"}]},"ts":"1680281648226"} 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,228 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,229 DEBUG [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/family1 2023-03-31 16:54:08,229 DEBUG [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/family1 2023-03-31 16:54:08,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-03-31 16:54:08,229 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a6bc2c65d66d97bc6535fe98d1f8cfc columnFamilyName family1 2023-03-31 16:54:08,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 57a0c62f5ac9e62580d0ef1c0c3118f6, server=jenkins-hbase4.apache.org,41157,1680281619369 in 175 msec 2023-03-31 16:54:08,230 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] regionserver.HStore(310): Store=8a6bc2c65d66d97bc6535fe98d1f8cfc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57a0c62f5ac9e62580d0ef1c0c3118f6, ASSIGN in 333 msec 2023-03-31 16:54:08,231 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,232 DEBUG [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/family2 2023-03-31 16:54:08,232 DEBUG [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/family2 2023-03-31 16:54:08,233 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a6bc2c65d66d97bc6535fe98d1f8cfc columnFamilyName family2 2023-03-31 16:54:08,234 INFO [StoreOpener-8a6bc2c65d66d97bc6535fe98d1f8cfc-1] regionserver.HStore(310): Store=8a6bc2c65d66d97bc6535fe98d1f8cfc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:08,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:54:08,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:08,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a6bc2c65d66d97bc6535fe98d1f8cfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59821528, jitterRate=-0.108589768409729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:08,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a6bc2c65d66d97bc6535fe98d1f8cfc: 2023-03-31 16:54:08,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc., pid=33, masterSystemTime=1680281648204 2023-03-31 16:54:08,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:08,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:08,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea65ff07c2e9369016f64da014f99098, NAME => 'testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.', STARTKEY => '', ENDKEY => '1'} 2023-03-31 16:54:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8a6bc2c65d66d97bc6535fe98d1f8cfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,242 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1680281648242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281648242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281648242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281648242"}]},"ts":"1680281648242"} 2023-03-31 16:54:08,243 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,245 DEBUG [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/family1 2023-03-31 16:54:08,245 DEBUG [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/family1 2023-03-31 16:54:08,245 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea65ff07c2e9369016f64da014f99098 columnFamilyName family1 2023-03-31 16:54:08,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-03-31 16:54:08,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 8a6bc2c65d66d97bc6535fe98d1f8cfc, server=jenkins-hbase4.apache.org,41157,1680281619369 in 189 msec 2023-03-31 16:54:08,246 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] regionserver.HStore(310): Store=ea65ff07c2e9369016f64da014f99098/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,247 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8a6bc2c65d66d97bc6535fe98d1f8cfc, ASSIGN in 349 msec 2023-03-31 16:54:08,248 DEBUG [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/family2 2023-03-31 16:54:08,248 DEBUG [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/family2 2023-03-31 16:54:08,248 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea65ff07c2e9369016f64da014f99098 columnFamilyName family2 2023-03-31 16:54:08,249 INFO [StoreOpener-ea65ff07c2e9369016f64da014f99098-1] regionserver.HStore(310): Store=ea65ff07c2e9369016f64da014f99098/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:08,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:08,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea65ff07c2e9369016f64da014f99098 2023-03-31 16:54:08,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:08,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea65ff07c2e9369016f64da014f99098; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59052567, jitterRate=-0.12004818022251129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:08,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea65ff07c2e9369016f64da014f99098: 2023-03-31 16:54:08,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098., pid=31, masterSystemTime=1680281648204 2023-03-31 16:54:08,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:08,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:08,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ea65ff07c2e9369016f64da014f99098, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:08,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1680281648258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281648258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281648258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281648258"}]},"ts":"1680281648258"} 2023-03-31 16:54:08,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-03-31 16:54:08,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure ea65ff07c2e9369016f64da014f99098, server=jenkins-hbase4.apache.org,41157,1680281619369 in 208 msec 2023-03-31 16:54:08,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-31 16:54:08,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ea65ff07c2e9369016f64da014f99098, ASSIGN in 365 msec 2023-03-31 16:54:08,264 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:08,264 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281648264"}]},"ts":"1680281648264"} 2023-03-31 16:54:08,265 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-31 16:54:08,267 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:08,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2180 sec 2023-03-31 16:54:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-31 16:54:09,158 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-31 16:54:09,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:09,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,167 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-31 16:54:09,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:09,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-31 16:54:09,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-31 16:54:09,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,167 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,168 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:09,168 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:09,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:09,169 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:09,169 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-31 16:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-31 16:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. started... 2023-03-31 16:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:09,170 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8a6bc2c65d66d97bc6535fe98d1f8cfc: 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. started... 2023-03-31 16:54:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ea65ff07c2e9369016f64da014f99098: 2023-03-31 16:54:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:09,171 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. started... 2023-03-31 16:54:09,171 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:09,172 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 57a0c62f5ac9e62580d0ef1c0c3118f6 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-31 16:54:09,586 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303316ded43188a9546acbdebafef9ce6cacd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303316ded43188a9546acbdebafef9ce6cacd 2023-03-31 16:54:09,992 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp/family1/af40dc7a7ede49cb976409a6e8f6c92c 2023-03-31 16:54:09,997 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp/family1/af40dc7a7ede49cb976409a6e8f6c92c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c 2023-03-31 16:54:10,003 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c, entries=1, sequenceid=5, filesize=4.9 K 2023-03-31 16:54:10,004 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 57a0c62f5ac9e62580d0ef1c0c3118f6 in 832ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:10,004 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-31 16:54:10,005 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:10,005 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-31 16:54:10,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-31 16:54:10,007 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,007 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:10,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:10,008 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,008 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:10,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-31 16:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bb30ac7[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:10,009 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-31 16:54:10,009 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,011 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,012 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-31 16:54:10,012 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-31 16:54:10,012 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:10,012 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,012 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:10,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,013 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-31 16:54:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:10,013 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:10,014 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-31 16:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:10,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-31 16:54:10,017 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-31 16:54:10,017 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:10,017 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:10,017 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,017 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:10,019 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,019 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,019 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:10,019 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:10,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:10,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:10,021 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,028 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:10,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-31 16:54:10,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:10,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-31 16:54:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:10,028 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,029 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:10,029 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,029 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,029 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:10,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:10,129 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:10,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:10,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:10,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:10,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,143 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-31 16:54:10,143 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:10,143 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-31 16:54:10,143 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-31 16:54:10,144 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,144 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,145 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:10,145 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:10,146 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,146 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-31 16:54:10,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,147 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-31 16:54:10,147 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:10,147 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-31 16:54:10,148 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:10,148 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. started... 2023-03-31 16:54:10,148 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8a6bc2c65d66d97bc6535fe98d1f8cfc: 2023-03-31 16:54:10,148 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:54:10,152 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:10,152 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. started... 2023-03-31 16:54:10,152 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 57a0c62f5ac9e62580d0ef1c0c3118f6 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-31 16:54:10,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:10,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:10,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:10,160 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:10,160 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. started... 2023-03-31 16:54:10,161 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ea65ff07c2e9369016f64da014f99098: 2023-03-31 16:54:10,161 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:54:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:10,582 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033137d7ad52066448e9809facb335f2dd64 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023033137d7ad52066448e9809facb335f2dd64 2023-03-31 16:54:10,987 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp/family1/d3297850abae449d92f95543f7b0659e 2023-03-31 16:54:10,992 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp/family1/d3297850abae449d92f95543f7b0659e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e 2023-03-31 16:54:10,996 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e, entries=2, sequenceid=9, filesize=5.0 K 2023-03-31 16:54:10,997 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 57a0c62f5ac9e62580d0ef1c0c3118f6 in 845ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:10,997 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:10,997 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:10,997 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:10,997 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-31 16:54:10,998 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-31 16:54:10,999 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:10,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-31 16:54:11,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c696c28[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:11,001 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-31 16:54:11,001 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-31 16:54:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-31 16:54:11,002 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,003 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-31 16:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:11,005 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-31 16:54:11,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:11,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-31 16:54:11,008 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-31 16:54:11,008 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:11,008 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:11,008 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,008 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:11,009 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,009 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,010 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:11,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:11,010 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,011 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:11,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:11,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-31 16:54:11,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:11,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:11,013 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:11,013 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:11,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:11,014 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:11,114 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:11,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:11,122 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-31 16:54:11,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-31 16:54:11,124 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-31 16:54:11,125 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282251125 2023-03-31 16:54:11,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:11,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:11,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-31 16:54:11,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-31 16:54:11,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x6b542ff9 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:11,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dac569a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:11,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230331 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-31 16:54:11,570 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033107f9100ae11f4476aa16b15964cb1cfe to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023033107f9100ae11f4476aa16b15964cb1cfe 2023-03-31 16:54:11,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-31 16:54:11,586 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:11,587 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35224, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:11,594 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:11,596 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:11,605 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230331/family1/1239f67066394cae82d6e81b4c63e301 first=Optional[k0] last=Optional[k1] 2023-03-31 16:54:11,605 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230331/family1/1239f67066394cae82d6e81b4c63e301}] 2023-03-31 16:54:11,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230331/family1/1239f67066394cae82d6e81b4c63e301 for inclusion in 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 2023-03-31 16:54:11,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-31 16:54:11,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-31 16:54:11,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:11,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230331/family1/1239f67066394cae82d6e81b4c63e301 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testScannerOnBulkLoadRefHFiles__re7eqmm8dc5qjl01lrtvacp1aos71hhp64ja1q4haoccnk82ipl8slr0jm45s41m/family1/1239f67066394cae82d6e81b4c63e301 2023-03-31 16:54:11,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testScannerOnBulkLoadRefHFiles__re7eqmm8dc5qjl01lrtvacp1aos71hhp64ja1q4haoccnk82ipl8slr0jm45s41m/family1/1239f67066394cae82d6e81b4c63e301 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_ 2023-03-31 16:54:11,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testScannerOnBulkLoadRefHFiles__re7eqmm8dc5qjl01lrtvacp1aos71hhp64ja1q4haoccnk82ipl8slr0jm45s41m/family1/1239f67066394cae82d6e81b4c63e301 into 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_ - updating store file list. 2023-03-31 16:54:11,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_ into 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 2023-03-31 16:54:11,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testScannerOnBulkLoadRefHFiles__re7eqmm8dc5qjl01lrtvacp1aos71hhp64ja1q4haoccnk82ipl8slr0jm45s41m/family1/1239f67066394cae82d6e81b4c63e301 into 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_) 2023-03-31 16:54:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testScannerOnBulkLoadRefHFiles__re7eqmm8dc5qjl01lrtvacp1aos71hhp64ja1q4haoccnk82ipl8slr0jm45s41m/family1/1239f67066394cae82d6e81b4c63e301 2023-03-31 16:54:11,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:54:11,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:54:11,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 is initiating minor compaction (all files) 2023-03-31 16:54:11,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@74bc242b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:11,622 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 in testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:54:11,622 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp, totalSize=15.1 K 2023-03-31 16:54:11,622 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting af40dc7a7ede49cb976409a6e8f6c92c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281649158 2023-03-31 16:54:11,623 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d3297850abae449d92f95543f7b0659e, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281649158 2023-03-31 16:54:11,623 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281649158 2023-03-31 16:54:11,624 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-31 16:54:11,625 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:11,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023033137d7ad52066448e9809facb335f2dd64 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023033137d7ad52066448e9809facb335f2dd64 2023-03-31 16:54:11,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303316ded43188a9546acbdebafef9ce6cacd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303316ded43188a9546acbdebafef9ce6cacd 2023-03-31 16:54:11,629 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-31 16:54:11,629 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230331' 2023-03-31 16:54:11,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230331 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-31 16:54:11,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-31 16:54:11,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:11,636 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-31 16:54:11,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 514 msec 2023-03-31 16:54:11,644 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 57a0c62f5ac9e62580d0ef1c0c3118f6#family1#compaction#37 average throughput is 0.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:11,669 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253 (was 262), OpenFileDescriptor=616 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 403), ProcessCount=169 (was 169), AvailableMemoryMB=3826 (was 3812) - AvailableMemoryMB LEAK? - 2023-03-31 16:54:11,680 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=169, AvailableMemoryMB=3826 2023-03-31 16:54:11,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:54:11,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:11,684 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:11,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-31 16:54:11,685 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:11,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:11,686 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:11,687 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7 empty. 2023-03-31 16:54:11,687 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:11,687 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-31 16:54:11,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:11,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:12,095 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:12,097 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 724908ac2aaaf3b89f3ceb67b0d48ee7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:12,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 724908ac2aaaf3b89f3ceb67b0d48ee7, disabling compactions & flushes 2023-03-31 16:54:12,503 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. after waiting 0 ms 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,503 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,503 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:12,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:12,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281652506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281652506"}]},"ts":"1680281652506"} 2023-03-31 16:54:12,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:54:12,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:12,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281652509"}]},"ts":"1680281652509"} 2023-03-31 16:54:12,510 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-31 16:54:12,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=724908ac2aaaf3b89f3ceb67b0d48ee7, ASSIGN}] 2023-03-31 16:54:12,515 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=724908ac2aaaf3b89f3ceb67b0d48ee7, ASSIGN 2023-03-31 16:54:12,516 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=724908ac2aaaf3b89f3ceb67b0d48ee7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:12,667 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=724908ac2aaaf3b89f3ceb67b0d48ee7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:12,667 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281652667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281652667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281652667"}]},"ts":"1680281652667"} 2023-03-31 16:54:12,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 724908ac2aaaf3b89f3ceb67b0d48ee7, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:12,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:12,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 724908ac2aaaf3b89f3ceb67b0d48ee7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:12,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:12,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,825 INFO [StoreOpener-724908ac2aaaf3b89f3ceb67b0d48ee7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,826 DEBUG [StoreOpener-724908ac2aaaf3b89f3ceb67b0d48ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:12,826 DEBUG [StoreOpener-724908ac2aaaf3b89f3ceb67b0d48ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:12,826 INFO [StoreOpener-724908ac2aaaf3b89f3ceb67b0d48ee7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 724908ac2aaaf3b89f3ceb67b0d48ee7 columnFamilyName family1 2023-03-31 16:54:12,828 INFO [StoreOpener-724908ac2aaaf3b89f3ceb67b0d48ee7-1] regionserver.HStore(310): Store=724908ac2aaaf3b89f3ceb67b0d48ee7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:12,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:54:12,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:12,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 724908ac2aaaf3b89f3ceb67b0d48ee7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73947449, jitterRate=0.10190285742282867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:12,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:12,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7., pid=37, masterSystemTime=1680281652820 2023-03-31 16:54:12,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:12,836 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=724908ac2aaaf3b89f3ceb67b0d48ee7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:12,836 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1680281652836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281652836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281652836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281652836"}]},"ts":"1680281652836"} 2023-03-31 16:54:12,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-31 16:54:12,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 724908ac2aaaf3b89f3ceb67b0d48ee7, server=jenkins-hbase4.apache.org,41157,1680281619369 in 168 msec 2023-03-31 16:54:12,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-31 16:54:12,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=724908ac2aaaf3b89f3ceb67b0d48ee7, ASSIGN in 325 msec 2023-03-31 16:54:12,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:12,841 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281652841"}]},"ts":"1680281652841"} 2023-03-31 16:54:12,842 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-31 16:54:12,844 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:12,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1620 sec 2023-03-31 16:54:12,864 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/.tmp/family1/7a3505fde9bb4a65af91b2779b05dec7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/7a3505fde9bb4a65af91b2779b05dec7 2023-03-31 16:54:12,869 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 57a0c62f5ac9e62580d0ef1c0c3118f6/family1 of 57a0c62f5ac9e62580d0ef1c0c3118f6 into 7a3505fde9bb4a65af91b2779b05dec7(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:54:12,869 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:54:12,869 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1680281651621; duration=1sec 2023-03-31 16:54:12,869 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:12,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_] to archive 2023-03-31 16:54:12,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:12,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/af40dc7a7ede49cb976409a6e8f6c92c 2023-03-31 16:54:12,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/d3297850abae449d92f95543f7b0659e 2023-03-31 16:54:12,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/family1/3fd55b204ad44e4c91d63cbbf57df305_SeqId_12_ 2023-03-31 16:54:13,710 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:13,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-31 16:54:13,791 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-31 16:54:13,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:13,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,814 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:13,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:13,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:13,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:13,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,815 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:13,815 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:13,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:13,816 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:13,816 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,817 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:13,817 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:13,818 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:13,818 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:54:14,241 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306aeb4b20bc044089abdf64b3f1bd3742 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306aeb4b20bc044089abdf64b3f1bd3742 2023-03-31 16:54:14,246 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/1d6868f25b3f49648d7dc544260a79dd 2023-03-31 16:54:14,254 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/1d6868f25b3f49648d7dc544260a79dd as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd 2023-03-31 16:54:14,261 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-31 16:54:14,262 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 444ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:14,262 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,263 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:14,263 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:14,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:14,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:14,263 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:14,265 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,265 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:14,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a539f20[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:14,268 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:14,268 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,269 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:14,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:14,269 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:14,270 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,270 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:14,271 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:14,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:14,275 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:14,275 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:14,275 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:14,275 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,275 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:14,278 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,278 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,278 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,279 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,281 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,284 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,284 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,284 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,284 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:14,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,284 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:14,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:14,284 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,285 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,385 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:14,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:14,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:14,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:14,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,404 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,404 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,404 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:14,404 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:14,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,407 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,412 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,412 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:14,412 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,412 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:14,416 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:14,416 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:14,416 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,416 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:14,416 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:54:14,437 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283fed471a160e4f5db756ab1b4c626895 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511283fed471a160e4f5db756ab1b4c626895 2023-03-31 16:54:14,449 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/d99a42b758874d47b7895856819e6220 2023-03-31 16:54:14,462 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/d99a42b758874d47b7895856819e6220 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220 2023-03-31 16:54:14,470 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:54:14,471 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 55ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:14,471 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:14,471 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:14,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:14,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:14,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:14,473 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,473 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,473 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,473 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:14,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710822a[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:14,475 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:14,475 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,481 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:14,482 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,482 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:14,482 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,483 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,483 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,483 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:14,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:14,486 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:14,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:14,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:14,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,486 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:14,489 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,489 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,489 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,490 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,493 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,495 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,496 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:14,497 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:14,496 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,597 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:14,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:14,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:14,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:14,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,612 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,612 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,612 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:14,612 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:14,613 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,613 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,614 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,614 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:14,615 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:14,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,616 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,624 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:14,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,624 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:14,624 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,624 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:14,628 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,628 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:14,628 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:14,675 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bd273b210d9c421abd1f427fd18ac764 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd273b210d9c421abd1f427fd18ac764 2023-03-31 16:54:14,703 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/9dd6add80dac41eba1793f3a5afca7e2 2023-03-31 16:54:14,709 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/9dd6add80dac41eba1793f3a5afca7e2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2 2023-03-31 16:54:14,714 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2, entries=1, sequenceid=13, filesize=4.9 K 2023-03-31 16:54:14,715 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 87ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:14,716 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:14,716 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:14,718 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,718 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,718 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:14,719 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:14,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6496453d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:14,721 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:14,721 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,723 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,723 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:14,723 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:14,723 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:14,723 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,723 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:14,724 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,725 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,725 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:14,730 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:14,730 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:14,730 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:14,730 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,730 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:14,737 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,737 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:14,737 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:14,738 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,741 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:14,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,744 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:14,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:14,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:14,744 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,745 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,745 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,745 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,745 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:14,745 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:14,845 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:14,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:14,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:14,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:14,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,868 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:14,868 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,868 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:14,868 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:14,869 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,869 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,871 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:14,871 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:14,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:14,871 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:14,871 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:14,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,874 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:14,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:14,876 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:14,876 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:14,876 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:14,880 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:14,880 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:14,880 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:14,880 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:14,881 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:15,300 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055d901d5ece614125ac61676e4923db8a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055d901d5ece614125ac61676e4923db8a 2023-03-31 16:54:15,306 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/f679ba9297db4ab5a94bbbed882b707b 2023-03-31 16:54:15,312 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/f679ba9297db4ab5a94bbbed882b707b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b 2023-03-31 16:54:15,316 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b, entries=1, sequenceid=17, filesize=4.9 K 2023-03-31 16:54:15,317 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 436ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:15,318 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:15,318 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:15,320 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,320 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,321 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,321 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:15,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:15,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63197dab[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:15,322 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:15,322 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,324 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,325 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:15,325 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:15,325 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:15,325 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,325 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:15,326 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,326 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:15,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,326 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:15,326 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:15,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:15,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:15,329 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:15,329 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:15,329 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:15,329 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,329 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:15,332 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,332 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,332 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:15,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:15,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:15,333 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,335 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,338 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:15,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:15,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:15,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,338 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:15,339 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:15,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:15,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:15,439 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:15,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:15,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:15,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:15,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,454 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:15,455 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,455 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,456 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:15,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:15,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,458 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:15,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,458 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:15,458 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:15,458 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:15,458 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:15,458 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:15,458 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:15,458 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:15,459 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:15,495 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228498f300d57fa48b79a5c1b98e4b91c1b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228498f300d57fa48b79a5c1b98e4b91c1b 2023-03-31 16:54:15,928 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/ca433f7ec0794b5ba3a80c32de7a901a 2023-03-31 16:54:15,937 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/ca433f7ec0794b5ba3a80c32de7a901a as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a 2023-03-31 16:54:15,944 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a, entries=1, sequenceid=21, filesize=4.9 K 2023-03-31 16:54:15,945 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 486ms, sequenceid=21, compaction requested=true 2023-03-31 16:54:15,946 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:15,946 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:15,951 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,952 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,952 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b54477[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:15,953 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:15,954 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,955 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:15,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:15,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:15,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:15,956 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:15,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:15,959 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:15,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:15,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:15,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,959 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:15,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:15,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:15,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:15,962 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,965 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,968 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,968 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,968 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,969 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:15,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:15,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:15,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:15,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:15,969 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:15,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:15,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:16,069 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:16,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:16,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:16,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:16,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,080 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:16,080 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:16,080 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:16,080 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:16,081 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,081 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,082 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:16,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:16,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:16,082 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,083 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,083 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:16,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,084 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:16,084 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:16,085 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:16,085 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:16,085 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:16,085 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:16,085 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:16,085 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:16,101 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e477881f90b44b089e68ab3a56714010 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e477881f90b44b089e68ab3a56714010 2023-03-31 16:54:16,510 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/947e836288c64357ae4d6ea7be8d5fbb 2023-03-31 16:54:16,515 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/947e836288c64357ae4d6ea7be8d5fbb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb 2023-03-31 16:54:16,519 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb, entries=1, sequenceid=25, filesize=4.9 K 2023-03-31 16:54:16,520 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 435ms, sequenceid=25, compaction requested=true 2023-03-31 16:54:16,520 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:16,520 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:16,522 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,522 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:16,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:16,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:16,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b79b39[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:16,524 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:16,524 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,526 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:16,527 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,527 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:16,528 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:16,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:16,531 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:16,531 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:16,531 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:16,531 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,531 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:16,532 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,532 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:16,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:16,533 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,533 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:16,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,541 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:16,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,543 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:16,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:16,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:16,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:16,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:16,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:16,544 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:16,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:16,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:16,644 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:16,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:16,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:16,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:16,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,652 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:16,652 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:16,652 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:16,652 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:16,653 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,653 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,655 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:16,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:16,656 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,656 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:16,656 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:16,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,657 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:16,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:16,658 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:16,658 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:16,658 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:16,686 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101432158d8ca0c4b67829aec3f1a3bf88f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101432158d8ca0c4b67829aec3f1a3bf88f 2023-03-31 16:54:17,099 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/43aaaa85258c44bd903acc03d0e64b13 2023-03-31 16:54:17,105 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/43aaaa85258c44bd903acc03d0e64b13 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13 2023-03-31 16:54:17,113 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13, entries=1, sequenceid=29, filesize=4.9 K 2023-03-31 16:54:17,114 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 456ms, sequenceid=29, compaction requested=true 2023-03-31 16:54:17,114 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:17,114 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:17,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:17,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:17,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:17,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:17,117 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:17,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@305e857f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:17,119 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:17,119 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,121 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,121 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:17,121 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,122 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:17,122 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:17,122 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:17,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:17,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:17,126 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:17,126 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:17,126 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:17,126 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,126 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:17,128 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,129 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,129 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:17,129 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,131 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,134 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:17,134 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:17,134 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:17,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:17,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:17,135 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:17,235 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:17,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:17,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:17,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:17,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,243 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:17,243 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:17,243 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:17,243 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:17,244 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,244 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,249 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,249 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:17,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:17,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:17,249 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,249 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,250 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,250 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:17,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:17,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:17,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:17,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:17,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:17,251 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:17,251 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:17,251 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:17,670 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032e54ca0dd2cd4c0788cc12972c102593 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032e54ca0dd2cd4c0788cc12972c102593 2023-03-31 16:54:17,676 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/e796d803915e48b0b804123c65969c81 2023-03-31 16:54:17,681 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/e796d803915e48b0b804123c65969c81 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81 2023-03-31 16:54:17,685 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81, entries=1, sequenceid=33, filesize=4.9 K 2023-03-31 16:54:17,686 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 435ms, sequenceid=33, compaction requested=true 2023-03-31 16:54:17,686 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:17,686 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:17,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:17,688 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,688 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:17,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@180252fa[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:17,690 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:17,690 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,691 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:17,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:17,691 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:17,692 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,692 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:17,693 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:17,693 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:17,693 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,693 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:17,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:17,695 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:17,695 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:17,695 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:17,695 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,695 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:17,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:17,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:17,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:17,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,700 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:17,702 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:17,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:17,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,703 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,703 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:17,703 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:17,803 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:17,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:17,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:17,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:17,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,811 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:17,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:17,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:17,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:17,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,813 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:17,813 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:17,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:17,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:17,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,815 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,815 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:17,816 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:17,816 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:17,816 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:17,817 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:18,251 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ed20dcafd5474e269c0a3b971f24c616 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907ed20dcafd5474e269c0a3b971f24c616 2023-03-31 16:54:18,672 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/cd94f8f06c6b49498b03febd62bf43cd 2023-03-31 16:54:18,678 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/cd94f8f06c6b49498b03febd62bf43cd as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd 2023-03-31 16:54:18,682 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd, entries=1, sequenceid=37, filesize=4.9 K 2023-03-31 16:54:18,683 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 866ms, sequenceid=37, compaction requested=true 2023-03-31 16:54:18,684 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:18,684 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:18,686 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575b2b71[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:18,688 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:18,688 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,689 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:18,689 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,689 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:18,690 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:18,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:18,693 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:18,693 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:18,693 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:18,693 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,693 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:18,696 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,696 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,696 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:18,697 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,698 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,700 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:18,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:18,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:18,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:18,701 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:18,700 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:18,801 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:18,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:18,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:18,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:18,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,809 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:18,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:18,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-31 16:54:18,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-31 16:54:18,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,812 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:18,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:18,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:18,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:18,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:18,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,813 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,813 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-31 16:54:18,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-31 16:54:18,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:18,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-31 16:54:18,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:18,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:18,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:18,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. started... 2023-03-31 16:54:18,814 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 724908ac2aaaf3b89f3ceb67b0d48ee7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:18,843 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200ba5165f15654c1ba5238ee4bbac9e30 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511200ba5165f15654c1ba5238ee4bbac9e30 2023-03-31 16:54:18,857 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/583a130b826d4f1abe17c662bdd72512 2023-03-31 16:54:18,865 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/583a130b826d4f1abe17c662bdd72512 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512 2023-03-31 16:54:18,882 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512, entries=1, sequenceid=41, filesize=4.9 K 2023-03-31 16:54:18,883 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 724908ac2aaaf3b89f3ceb67b0d48ee7 in 69ms, sequenceid=41, compaction requested=true 2023-03-31 16:54:18,883 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:18,883 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:18,883 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:18,883 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:18,883 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,883 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-31 16:54:18,883 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-31 16:54:18,895 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,895 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,896 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:18,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-31 16:54:18,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@def1cf0[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:18,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-31 16:54:18,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,900 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-31 16:54:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-31 16:54:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:18,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:18,904 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,904 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-31 16:54:18,904 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:18,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,904 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-31 16:54:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:18,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:54:18,909 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-31 16:54:18,909 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:18,909 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:18,909 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,909 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:18,913 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,913 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:18,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,913 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:18,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,914 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,917 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,922 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:18,922 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:18,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:18,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-31 16:54:18,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:18,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-31 16:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:18,923 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:18,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:18,924 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:19,024 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:19,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:19,028 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-31 16:54:19,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:19,041 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:19,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:19,042 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282259042 2023-03-31 16:54:19,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:19,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-31 16:54:19,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:19,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x3a9c8dee to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:19,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@754b14a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:19,063 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:19,952 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ae35ea8296c742f785771db1d5b8e43f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae35ea8296c742f785771db1d5b8e43f 2023-03-31 16:54:19,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:19,971 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:19,972 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56020, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:19,980 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:19,981 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:20,001 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2495feaccfa94791b8de61a69e4e6c3f first=Optional[r3] last=Optional[r6] 2023-03-31 16:54:20,002 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2495feaccfa94791b8de61a69e4e6c3f}] 2023-03-31 16:54:20,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2495feaccfa94791b8de61a69e4e6c3f for inclusion in 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-31 16:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:20,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2495feaccfa94791b8de61a69e4e6c3f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdsqa73cn6n637202g9pt3ht3dfvnmoimu6kl7ogi4s0oe1jjr7o4h0pbusdh8pg/family1/2495feaccfa94791b8de61a69e4e6c3f 2023-03-31 16:54:20,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdsqa73cn6n637202g9pt3ht3dfvnmoimu6kl7ogi4s0oe1jjr7o4h0pbusdh8pg/family1/2495feaccfa94791b8de61a69e4e6c3f as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_ 2023-03-31 16:54:20,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdsqa73cn6n637202g9pt3ht3dfvnmoimu6kl7ogi4s0oe1jjr7o4h0pbusdh8pg/family1/2495feaccfa94791b8de61a69e4e6c3f into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_ - updating store file list. 2023-03-31 16:54:20,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_ into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:20,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdsqa73cn6n637202g9pt3ht3dfvnmoimu6kl7ogi4s0oe1jjr7o4h0pbusdh8pg/family1/2495feaccfa94791b8de61a69e4e6c3f into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_) 2023-03-31 16:54:20,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdsqa73cn6n637202g9pt3ht3dfvnmoimu6kl7ogi4s0oe1jjr7o4h0pbusdh8pg/family1/2495feaccfa94791b8de61a69e4e6c3f 2023-03-31 16:54:20,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:54:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:54:20,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 is initiating minor compaction 2023-03-31 16:54:20,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7e54dfb3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:20,025 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 in testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:20,025 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp, totalSize=50.0 K 2023-03-31 16:54:20,025 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d99a42b758874d47b7895856819e6220, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:54:20,025 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 9dd6add80dac41eba1793f3a5afca7e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:54:20,025 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting f679ba9297db4ab5a94bbbed882b707b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:54:20,025 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting ca433f7ec0794b5ba3a80c32de7a901a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:54:20,025 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 947e836288c64357ae4d6ea7be8d5fbb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:54:20,026 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 43aaaa85258c44bd903acc03d0e64b13, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:54:20,026 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting e796d803915e48b0b804123c65969c81, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:54:20,026 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting cd94f8f06c6b49498b03febd62bf43cd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:54:20,026 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 583a130b826d4f1abe17c662bdd72512, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:54:20,026 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:54:20,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:20,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:20,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228498f300d57fa48b79a5c1b98e4b91c1b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228498f300d57fa48b79a5c1b98e4b91c1b 2023-03-31 16:54:20,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e477881f90b44b089e68ab3a56714010 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231e477881f90b44b089e68ab3a56714010 2023-03-31 16:54:20,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101432158d8ca0c4b67829aec3f1a3bf88f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101432158d8ca0c4b67829aec3f1a3bf88f 2023-03-31 16:54:20,041 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032e54ca0dd2cd4c0788cc12972c102593 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032e54ca0dd2cd4c0788cc12972c102593 2023-03-31 16:54:20,041 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-31 16:54:20,041 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:20,104 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 724908ac2aaaf3b89f3ceb67b0d48ee7#family1#compaction#48 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:20,540 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/936993405d184e7492498b1ba358a321 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/936993405d184e7492498b1ba358a321 2023-03-31 16:54:20,546 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 of 724908ac2aaaf3b89f3ceb67b0d48ee7 into 936993405d184e7492498b1ba358a321(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:20,546 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:20,546 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1680281660025; duration=0sec 2023-03-31 16:54:20,546 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:20,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_] to archive 2023-03-31 16:54:20,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:20,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/d99a42b758874d47b7895856819e6220 2023-03-31 16:54:20,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/9dd6add80dac41eba1793f3a5afca7e2 2023-03-31 16:54:20,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/f679ba9297db4ab5a94bbbed882b707b 2023-03-31 16:54:20,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/ca433f7ec0794b5ba3a80c32de7a901a 2023-03-31 16:54:20,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/947e836288c64357ae4d6ea7be8d5fbb 2023-03-31 16:54:20,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/43aaaa85258c44bd903acc03d0e64b13 2023-03-31 16:54:20,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/e796d803915e48b0b804123c65969c81 2023-03-31 16:54:20,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/cd94f8f06c6b49498b03febd62bf43cd 2023-03-31 16:54:20,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/583a130b826d4f1abe17c662bdd72512 2023-03-31 16:54:20,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/49346ac1ef1e42fbb07d5e8e029b55b8_SeqId_44_ 2023-03-31 16:54:20,975 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5f0d925c24b47cdb015f5d3c761cb54 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5f0d925c24b47cdb015f5d3c761cb54 2023-03-31 16:54:20,976 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:21,022 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/50784d0d8e2344299c11b46c0918c11d first=Optional[r00] last=Optional[r2] 2023-03-31 16:54:21,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/50784d0d8e2344299c11b46c0918c11d}] 2023-03-31 16:54:21,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/50784d0d8e2344299c11b46c0918c11d for inclusion in 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:21,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-31 16:54:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:21,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/50784d0d8e2344299c11b46c0918c11d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cqmr04mgpi2mjo308r9nv6dq8sl1f7uagm8qr6d8so10aigvm1g61a2ojhbhojvn/family1/50784d0d8e2344299c11b46c0918c11d 2023-03-31 16:54:21,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cqmr04mgpi2mjo308r9nv6dq8sl1f7uagm8qr6d8so10aigvm1g61a2ojhbhojvn/family1/50784d0d8e2344299c11b46c0918c11d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_ 2023-03-31 16:54:21,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cqmr04mgpi2mjo308r9nv6dq8sl1f7uagm8qr6d8so10aigvm1g61a2ojhbhojvn/family1/50784d0d8e2344299c11b46c0918c11d into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_ - updating store file list. 2023-03-31 16:54:21,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_ into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 2023-03-31 16:54:21,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cqmr04mgpi2mjo308r9nv6dq8sl1f7uagm8qr6d8so10aigvm1g61a2ojhbhojvn/family1/50784d0d8e2344299c11b46c0918c11d into 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_) 2023-03-31 16:54:21,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cqmr04mgpi2mjo308r9nv6dq8sl1f7uagm8qr6d8so10aigvm1g61a2ojhbhojvn/family1/50784d0d8e2344299c11b46c0918c11d 2023-03-31 16:54:21,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 is initiating minor compaction (all files) 2023-03-31 16:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@41943f3d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:21,043 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 in testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:54:21,044 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/936993405d184e7492498b1ba358a321, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp, totalSize=337.0 K 2023-03-31 16:54:21,044 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 1d6868f25b3f49648d7dc544260a79dd, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:54:21,045 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 936993405d184e7492498b1ba358a321, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:54:21,046 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842768 2023-03-31 16:54:21,048 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:21,049 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:21,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306aeb4b20bc044089abdf64b3f1bd3742 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511306aeb4b20bc044089abdf64b3f1bd3742 2023-03-31 16:54:21,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd273b210d9c421abd1f427fd18ac764 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd273b210d9c421abd1f427fd18ac764 2023-03-31 16:54:21,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055d901d5ece614125ac61676e4923db8a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055d901d5ece614125ac61676e4923db8a 2023-03-31 16:54:21,055 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-31 16:54:21,055 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-31 16:54:21,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-31 16:54:21,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-31 16:54:21,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:21,058 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:54:21,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 2.0230 sec 2023-03-31 16:54:21,069 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 724908ac2aaaf3b89f3ceb67b0d48ee7#family1#compaction#49 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:21,201 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260 (was 253) - Thread LEAK? -, OpenFileDescriptor=628 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 371), ProcessCount=169 (was 169), AvailableMemoryMB=3784 (was 3826) 2023-03-31 16:54:21,215 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=260, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=169, AvailableMemoryMB=3783 2023-03-31 16:54:21,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:54:21,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:21,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:21,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-31 16:54:21,222 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:21,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-31 16:54:21,228 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,229 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 empty. 2023-03-31 16:54:21,229 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,229 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-31 16:54:21,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-31 16:54:21,509 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/.tmp/family1/6512f2f3821948e99e55920ece2908f7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/6512f2f3821948e99e55920ece2908f7 2023-03-31 16:54:21,516 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 724908ac2aaaf3b89f3ceb67b0d48ee7/family1 of 724908ac2aaaf3b89f3ceb67b0d48ee7 into 6512f2f3821948e99e55920ece2908f7(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:21,516 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:54:21,516 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1680281661043; duration=0sec 2023-03-31 16:54:21,517 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:21,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-31 16:54:21,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/936993405d184e7492498b1ba358a321, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_] to archive 2023-03-31 16:54:21,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:21,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/1d6868f25b3f49648d7dc544260a79dd 2023-03-31 16:54:21,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/936993405d184e7492498b1ba358a321 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/936993405d184e7492498b1ba358a321 2023-03-31 16:54:21,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/family1/4be9c025dc1c49cbbf16f6ef65b0a80a_SeqId_47_ 2023-03-31 16:54:21,645 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:21,646 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => ac187f8886d6480a15f5aa4cdc3a4bd3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing ac187f8886d6480a15f5aa4cdc3a4bd3, disabling compactions & flushes 2023-03-31 16:54:21,655 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. after waiting 0 ms 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:21,655 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:21,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:21,658 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:21,659 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281661659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281661659"}]},"ts":"1680281661659"} 2023-03-31 16:54:21,661 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:54:21,662 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:21,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281661662"}]},"ts":"1680281661662"} 2023-03-31 16:54:21,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-31 16:54:21,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, ASSIGN}] 2023-03-31 16:54:21,682 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, ASSIGN 2023-03-31 16:54:21,684 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:21,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-31 16:54:21,835 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:21,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281661835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281661835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281661835"}]},"ts":"1680281661835"} 2023-03-31 16:54:21,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:21,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:21,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac187f8886d6480a15f5aa4cdc3a4bd3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:21,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:21,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,994 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,995 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:21,996 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:21,996 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac187f8886d6480a15f5aa4cdc3a4bd3 columnFamilyName family1 2023-03-31 16:54:21,997 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(310): Store=ac187f8886d6480a15f5aa4cdc3a4bd3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:21,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:21,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:22,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:22,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:22,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac187f8886d6480a15f5aa4cdc3a4bd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59910423, jitterRate=-0.10726512968540192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:22,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:22,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., pid=41, masterSystemTime=1680281661989 2023-03-31 16:54:22,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:22,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:22,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:22,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281662006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281662006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281662006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281662006"}]},"ts":"1680281662006"} 2023-03-31 16:54:22,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-31 16:54:22,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369 in 170 msec 2023-03-31 16:54:22,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-31 16:54:22,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, ASSIGN in 340 msec 2023-03-31 16:54:22,011 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:22,011 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281662011"}]},"ts":"1680281662011"} 2023-03-31 16:54:22,013 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-31 16:54:22,014 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:22,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 797 msec 2023-03-31 16:54:22,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-31 16:54:22,327 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-31 16:54:22,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,360 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:22,360 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:22,360 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:22,360 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:22,361 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,361 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,362 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:22,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:22,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:22,363 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,364 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:22,364 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:22,365 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:22,365 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:22,365 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:22,365 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:22,365 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:54:22,791 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b7c6be5dad49450281f0f30681bfb8dd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b7c6be5dad49450281f0f30681bfb8dd 2023-03-31 16:54:23,116 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:23,196 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/e55c09562d174d03bde0c19c3f4cacf3 2023-03-31 16:54:23,202 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/e55c09562d174d03bde0c19c3f4cacf3 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3 2023-03-31 16:54:23,206 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-31 16:54:23,207 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 842ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:23,208 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:23,208 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:23,208 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:23,208 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:23,208 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,208 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:23,208 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:23,210 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,210 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:23,210 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,210 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:23,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:23,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:23,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495e054f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:23,212 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:23,212 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,213 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,213 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:23,213 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:23,213 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:23,213 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,213 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:23,215 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,215 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:23,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:23,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:23,215 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:23,215 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:23,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:23,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:23,217 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:23,217 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:23,217 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:23,217 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,217 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:23,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,222 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,223 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:23,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:23,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:23,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:23,226 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:23,227 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:23,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:23,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:23,227 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,227 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,227 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,327 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:23,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:23,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:23,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:23,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,334 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:23,334 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:23,334 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:23,334 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:23,335 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,335 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,336 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:23,336 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:23,337 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:23,337 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:23,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:23,339 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:23,339 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:23,340 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:54:23,754 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282e8f1fb8c89e4a40bd07c27e91481315 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282e8f1fb8c89e4a40bd07c27e91481315 2023-03-31 16:54:24,166 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/d8441f9636c645a9824d32ea8c0824b5 2023-03-31 16:54:24,182 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/d8441f9636c645a9824d32ea8c0824b5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5 2023-03-31 16:54:24,189 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:54:24,190 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 851ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:24,190 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:24,190 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:24,191 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:24,193 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,193 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,193 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,193 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43411b1c[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:24,195 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:24,195 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,196 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,197 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,197 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:24,198 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:24,198 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:24,199 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:24,199 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:24,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:24,203 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:24,204 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:24,204 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:24,204 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,204 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:24,207 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,207 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,207 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,209 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,210 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,216 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:24,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:24,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:24,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:24,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:24,216 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:24,217 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:24,217 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:24,217 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,217 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:24,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:24,317 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:24,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:24,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:24,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:24,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,326 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:24,326 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:24,326 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:24,326 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:24,327 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,327 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,328 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:24,328 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:24,331 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,331 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:24,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,332 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:24,332 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:24,332 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:24,336 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:24,336 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:24,336 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:24,336 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:24,336 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:24,759 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120179e4c9cf55bf4b8cb0a65b4bef72a118 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120179e4c9cf55bf4b8cb0a65b4bef72a118 2023-03-31 16:54:24,770 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/2ded2060c4bb4427acdff8400a8676db 2023-03-31 16:54:24,776 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/2ded2060c4bb4427acdff8400a8676db as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db 2023-03-31 16:54:24,781 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db, entries=1, sequenceid=13, filesize=5.0 K 2023-03-31 16:54:24,782 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 446ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:24,782 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:24,782 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:24,784 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,786 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,786 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dcfa0a6[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:24,786 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:24,786 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,787 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,787 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:24,788 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,788 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:24,791 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:24,791 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:24,794 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:24,794 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:24,794 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:24,794 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,794 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:24,796 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,796 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:24,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:24,797 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:24,798 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,800 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:24,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,802 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:24,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:24,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:24,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:24,802 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:24,803 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:24,803 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:24,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:24,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:24,903 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:24,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:24,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:24,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:24,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,913 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:24,913 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:24,913 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:24,913 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:24,913 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,913 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,915 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,915 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:24,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:24,915 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:24,915 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:24,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:24,916 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:24,916 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:24,916 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:24,917 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:25,351 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205722faf9121b64e589680e896b4cd6191 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205722faf9121b64e589680e896b4cd6191 2023-03-31 16:54:25,758 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/feb79e8b2fcb4b2abeac3ace9243eedf 2023-03-31 16:54:25,763 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/feb79e8b2fcb4b2abeac3ace9243eedf as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf 2023-03-31 16:54:25,768 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf, entries=1, sequenceid=17, filesize=5.0 K 2023-03-31 16:54:25,769 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 852ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:25,769 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:25,769 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:25,769 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:25,772 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,772 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,773 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,773 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:25,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:25,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38323d73[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:25,774 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:25,774 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,775 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:25,775 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:25,775 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,775 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:25,777 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,777 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:25,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:25,779 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:25,779 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:25,779 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:25,779 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,779 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:25,781 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,781 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,781 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:25,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:25,781 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,783 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,785 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:25,786 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:25,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:25,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:25,790 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:25,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:25,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:25,790 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:25,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:25,790 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:25,890 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:25,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:25,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:25,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:25,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,898 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:25,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:25,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:25,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:25,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,898 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,900 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:25,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:25,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,901 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:25,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,901 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:25,901 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:25,901 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:25,901 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:25,901 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:25,901 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:25,901 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:25,902 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:25,921 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228af8da032f2ad430d91ab1bed854bb4e8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228af8da032f2ad430d91ab1bed854bb4e8 2023-03-31 16:54:25,929 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/910809af885d4c9b88d871bdc320bc03 2023-03-31 16:54:25,940 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/910809af885d4c9b88d871bdc320bc03 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03 2023-03-31 16:54:25,944 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03, entries=1, sequenceid=21, filesize=5.0 K 2023-03-31 16:54:25,945 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 43ms, sequenceid=21, compaction requested=true 2023-03-31 16:54:25,945 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:25,945 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:25,945 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:25,945 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:25,945 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:25,946 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:25,948 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:25,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff2347[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:25,950 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:25,950 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,954 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:25,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:25,954 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:25,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:25,956 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:25,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:25,956 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:25,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:25,959 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:25,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:25,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:25,959 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,959 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:25,962 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,962 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:25,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,962 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:25,963 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,967 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,981 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:25,981 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:25,981 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:25,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:25,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:25,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:25,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:25,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:25,982 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:25,982 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:25,982 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,982 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,982 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,983 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:25,983 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,983 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:25,983 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,082 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:26,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:26,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,102 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:26,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:26,102 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:26,103 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,103 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,106 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:26,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:26,106 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,107 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,107 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:26,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:26,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,108 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:26,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:26,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:26,116 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:26,116 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:26,116 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:26,135 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312d27632fb33843958379db049e8b1556 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312d27632fb33843958379db049e8b1556 2023-03-31 16:54:26,148 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/826918db73354ec5aeacc7d9204ad6ab 2023-03-31 16:54:26,154 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/826918db73354ec5aeacc7d9204ad6ab as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab 2023-03-31 16:54:26,159 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab, entries=1, sequenceid=25, filesize=5.0 K 2023-03-31 16:54:26,160 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 44ms, sequenceid=25, compaction requested=true 2023-03-31 16:54:26,160 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:26,160 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:26,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:26,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:26,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:26,160 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:26,162 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,162 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,162 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,162 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:26,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aad419f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:26,164 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:26,164 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,165 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:26,166 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,166 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:26,167 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:26,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:26,170 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:26,170 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:26,170 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:26,170 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,170 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:26,172 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,172 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:26,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,172 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,173 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,174 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:26,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,177 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:26,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:26,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:26,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:26,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:26,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:26,178 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:26,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:26,278 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:26,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:26,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,285 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:26,285 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,285 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:26,285 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:26,286 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,286 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,287 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,287 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:26,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:26,287 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,287 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:26,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,289 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:26,289 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,289 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:26,289 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:26,289 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:26,289 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:26,289 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:26,289 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:26,739 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:26,739 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40a1250d to 127.0.0.1:57785 2023-03-31 16:54:26,739 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:26,739 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:26,739 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b542ff9 to 127.0.0.1:57785 2023-03-31 16:54:26,739 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:26,739 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:26,739 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a9c8dee to 127.0.0.1:57785 2023-03-31 16:54:26,739 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:26,740 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f059bf9175304d5fa296502aed2adc38 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101f059bf9175304d5fa296502aed2adc38 2023-03-31 16:54:26,748 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/e3c9e02fa6e747d0a7ad20da670517f4 2023-03-31 16:54:26,753 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/e3c9e02fa6e747d0a7ad20da670517f4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4 2023-03-31 16:54:26,758 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4, entries=1, sequenceid=29, filesize=5.0 K 2023-03-31 16:54:26,759 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 470ms, sequenceid=29, compaction requested=true 2023-03-31 16:54:26,760 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:26,760 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:26,760 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:26,760 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:26,760 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,760 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:26,760 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:26,845 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,845 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:26,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a5702fc[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:26,847 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:26,847 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,848 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:26,849 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:26,849 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,849 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:26,851 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:26,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:26,854 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:26,854 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:26,854 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:26,854 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,854 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:26,858 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,858 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:26,858 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:26,859 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:26,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,861 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:26,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:26,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:26,863 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:26,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:26,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:26,863 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,864 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,864 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,864 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:26,964 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:26,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:26,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:26,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:26,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,972 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:26,972 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,972 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:26,972 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:26,973 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,973 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,974 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:26,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:26,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:26,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:26,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:26,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:26,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:26,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:26,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:26,976 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:26,976 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:26,976 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:26,976 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:27,007 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038d76888f437140b78f03c3373515821b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038d76888f437140b78f03c3373515821b 2023-03-31 16:54:27,030 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/1d68ce3e354543488f63bf3ba548e23d 2023-03-31 16:54:27,036 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/1d68ce3e354543488f63bf3ba548e23d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d 2023-03-31 16:54:27,041 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d, entries=1, sequenceid=33, filesize=5.0 K 2023-03-31 16:54:27,042 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 66ms, sequenceid=33, compaction requested=true 2023-03-31 16:54:27,043 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:27,043 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:27,043 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:27,043 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:27,043 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,043 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:27,043 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:27,045 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a76160[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:27,048 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:27,048 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,051 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:27,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:27,051 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,051 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:27,052 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:27,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:27,057 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:27,057 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:27,057 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:27,057 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,057 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:27,059 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,059 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,059 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:27,060 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,064 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:27,064 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:27,065 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,065 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:27,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:27,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:27,065 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:27,065 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:27,066 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:27,166 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:27,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:27,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:27,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:27,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,174 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:27,174 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:27,174 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:27,174 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:27,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,177 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:27,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:27,177 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,178 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,178 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:27,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:27,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:27,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:27,181 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:27,181 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:27,181 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:27,537 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:27,620 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ed2d6104ead546919b187404368afa78 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907ed2d6104ead546919b187404368afa78 2023-03-31 16:54:27,625 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/ed71fc26e2ac4bd08a58e35f2eec6b03 2023-03-31 16:54:27,631 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/ed71fc26e2ac4bd08a58e35f2eec6b03 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03 2023-03-31 16:54:27,636 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03, entries=1, sequenceid=37, filesize=5.0 K 2023-03-31 16:54:27,636 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 455ms, sequenceid=37, compaction requested=true 2023-03-31 16:54:27,636 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:27,636 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:27,640 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,640 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,640 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,640 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:27,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bba8548[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:27,641 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:27,641 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,642 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,643 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:27,643 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:27,643 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:27,643 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,643 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:27,644 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,644 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:27,644 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:27,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,644 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:27,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:27,647 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:27,647 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:27,647 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:27,647 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,647 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:27,648 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,648 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,648 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:27,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:27,649 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,650 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,655 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:27,655 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,656 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:27,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:27,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,656 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:27,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:27,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:27,756 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:27,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:27,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:27,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:27,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,763 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:27,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:27,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-31 16:54:27,763 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-31 16:54:27,764 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,764 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,765 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,765 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:27,765 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:27,765 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-31 16:54:27,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-31 16:54:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-31 16:54:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:27,767 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:27,767 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:27,767 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. started... 2023-03-31 16:54:27,767 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ac187f8886d6480a15f5aa4cdc3a4bd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:28,183 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c0e49b39c81f401dbbf2c09a098bba8d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0e49b39c81f401dbbf2c09a098bba8d 2023-03-31 16:54:28,201 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/2a3a20901f7248dd8c3ce6560f9ea3e8 2023-03-31 16:54:28,215 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/2a3a20901f7248dd8c3ce6560f9ea3e8 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8 2023-03-31 16:54:28,221 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8, entries=1, sequenceid=41, filesize=5.0 K 2023-03-31 16:54:28,222 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ac187f8886d6480a15f5aa4cdc3a4bd3 in 455ms, sequenceid=41, compaction requested=true 2023-03-31 16:54:28,222 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:28,222 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-31 16:54:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-31 16:54:28,224 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,224 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:28,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-31 16:54:28,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bbb9819[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:28,227 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-31 16:54:28,227 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,229 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-31 16:54:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-31 16:54:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:28,230 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,230 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:28,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-31 16:54:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-31 16:54:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:28,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-31 16:54:28,240 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-31 16:54:28,240 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:28,241 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:28,241 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,241 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:28,243 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,243 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:28,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,244 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,245 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,246 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:28,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:28,250 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-31 16:54:28,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,251 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:28,251 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:28,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:28,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-31 16:54:28,351 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:28,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:28,355 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:28,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:28,358 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:28,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:28,359 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282268359 2023-03-31 16:54:28,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:28,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-31 16:54:28,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:28,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x5c6cd804 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:28,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@712f3134, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:28,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,881 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb44f5c771654818b26939164c00c02f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb44f5c771654818b26939164c00c02f 2023-03-31 16:54:28,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:28,898 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:28,900 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:28,913 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:28,916 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60144, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:28,931 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5651bd46773449eba9a30719719f6802 first=Optional[r3] last=Optional[r6] 2023-03-31 16:54:28,932 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5651bd46773449eba9a30719719f6802}] 2023-03-31 16:54:28,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5651bd46773449eba9a30719719f6802 for inclusion in ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:28,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-31 16:54:28,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:28,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:28,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5651bd46773449eba9a30719719f6802 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hsuhjb0ah2j6a5bqhp67vl9f5f08u37m2b4c86mku7lr5n82fbmuu5ahlmnglqq6/family1/5651bd46773449eba9a30719719f6802 2023-03-31 16:54:28,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hsuhjb0ah2j6a5bqhp67vl9f5f08u37m2b4c86mku7lr5n82fbmuu5ahlmnglqq6/family1/5651bd46773449eba9a30719719f6802 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_ 2023-03-31 16:54:28,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hsuhjb0ah2j6a5bqhp67vl9f5f08u37m2b4c86mku7lr5n82fbmuu5ahlmnglqq6/family1/5651bd46773449eba9a30719719f6802 into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_ - updating store file list. 2023-03-31 16:54:28,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_ into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:28,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hsuhjb0ah2j6a5bqhp67vl9f5f08u37m2b4c86mku7lr5n82fbmuu5ahlmnglqq6/family1/5651bd46773449eba9a30719719f6802 into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_) 2023-03-31 16:54:28,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hsuhjb0ah2j6a5bqhp67vl9f5f08u37m2b4c86mku7lr5n82fbmuu5ahlmnglqq6/family1/5651bd46773449eba9a30719719f6802 2023-03-31 16:54:28,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:54:28,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:54:28,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): ac187f8886d6480a15f5aa4cdc3a4bd3/family1 is initiating minor compaction 2023-03-31 16:54:28,956 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ac187f8886d6480a15f5aa4cdc3a4bd3/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:28,957 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp, totalSize=50.4 K 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d8441f9636c645a9824d32ea8c0824b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 2ded2060c4bb4427acdff8400a8676db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting feb79e8b2fcb4b2abeac3ace9243eedf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 910809af885d4c9b88d871bdc320bc03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 826918db73354ec5aeacc7d9204ad6ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting e3c9e02fa6e747d0a7ad20da670517f4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 1d68ce3e354543488f63bf3ba548e23d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting ed71fc26e2ac4bd08a58e35f2eec6b03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 2a3a20901f7248dd8c3ce6560f9ea3e8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:54:28,957 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 83b3f377ee6848bd862aeb75db7c625c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:54:28,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@722594f2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:28,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:28,962 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:28,965 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228af8da032f2ad430d91ab1bed854bb4e8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228af8da032f2ad430d91ab1bed854bb4e8 2023-03-31 16:54:28,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312d27632fb33843958379db049e8b1556 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312d27632fb33843958379db049e8b1556 2023-03-31 16:54:28,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101f059bf9175304d5fa296502aed2adc38 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101f059bf9175304d5fa296502aed2adc38 2023-03-31 16:54:28,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038d76888f437140b78f03c3373515821b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038d76888f437140b78f03c3373515821b 2023-03-31 16:54:28,971 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-31 16:54:28,971 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-31 16:54:28,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:28,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:29,093 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): ac187f8886d6480a15f5aa4cdc3a4bd3#family1#compaction#60 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:29,526 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120568404df7300d4864b1670c15f53275ff to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120568404df7300d4864b1670c15f53275ff 2023-03-31 16:54:29,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:29,545 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/40e1b7aef9544a73b8a629662883b7cf as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/40e1b7aef9544a73b8a629662883b7cf 2023-03-31 16:54:29,552 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ac187f8886d6480a15f5aa4cdc3a4bd3/family1 of ac187f8886d6480a15f5aa4cdc3a4bd3 into 40e1b7aef9544a73b8a629662883b7cf(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:29,552 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:29,553 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680281668956; duration=0sec 2023-03-31 16:54:29,553 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:29,564 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48cffd2c96b6422ea9a256cc0d10a14a first=Optional[r00] last=Optional[r2] 2023-03-31 16:54:29,565 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48cffd2c96b6422ea9a256cc0d10a14a}] 2023-03-31 16:54:29,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48cffd2c96b6422ea9a256cc0d10a14a for inclusion in ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:29,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_] to archive 2023-03-31 16:54:29,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:29,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-31 16:54:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/48cffd2c96b6422ea9a256cc0d10a14a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9flg5681ab7pcofodirs17q0pvtn3th846573cdbmlnnpk9bqar0a49rvi8p776g/family1/48cffd2c96b6422ea9a256cc0d10a14a 2023-03-31 16:54:29,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/d8441f9636c645a9824d32ea8c0824b5 2023-03-31 16:54:29,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9flg5681ab7pcofodirs17q0pvtn3th846573cdbmlnnpk9bqar0a49rvi8p776g/family1/48cffd2c96b6422ea9a256cc0d10a14a as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_ 2023-03-31 16:54:29,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9flg5681ab7pcofodirs17q0pvtn3th846573cdbmlnnpk9bqar0a49rvi8p776g/family1/48cffd2c96b6422ea9a256cc0d10a14a into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_ - updating store file list. 2023-03-31 16:54:29,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2ded2060c4bb4427acdff8400a8676db 2023-03-31 16:54:29,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/feb79e8b2fcb4b2abeac3ace9243eedf 2023-03-31 16:54:29,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_ into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:29,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9flg5681ab7pcofodirs17q0pvtn3th846573cdbmlnnpk9bqar0a49rvi8p776g/family1/48cffd2c96b6422ea9a256cc0d10a14a into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_) 2023-03-31 16:54:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9flg5681ab7pcofodirs17q0pvtn3th846573cdbmlnnpk9bqar0a49rvi8p776g/family1/48cffd2c96b6422ea9a256cc0d10a14a 2023-03-31 16:54:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:54:29,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/910809af885d4c9b88d871bdc320bc03 2023-03-31 16:54:29,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/826918db73354ec5aeacc7d9204ad6ab 2023-03-31 16:54:29,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:54:29,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): ac187f8886d6480a15f5aa4cdc3a4bd3/family1 is initiating minor compaction (all files) 2023-03-31 16:54:29,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@517e3ac5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:29,603 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ac187f8886d6480a15f5aa4cdc3a4bd3/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:29,603 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/40e1b7aef9544a73b8a629662883b7cf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp, totalSize=390.1 K 2023-03-31 16:54:29,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e3c9e02fa6e747d0a7ad20da670517f4 2023-03-31 16:54:29,605 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting e55c09562d174d03bde0c19c3f4cacf3, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:54:29,606 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 40e1b7aef9544a73b8a629662883b7cf, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:54:29,607 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842768 2023-03-31 16:54:29,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:29,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/1d68ce3e354543488f63bf3ba548e23d 2023-03-31 16:54:29,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/ed71fc26e2ac4bd08a58e35f2eec6b03 2023-03-31 16:54:29,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:29,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/2a3a20901f7248dd8c3ce6560f9ea3e8 2023-03-31 16:54:29,619 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b7c6be5dad49450281f0f30681bfb8dd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130b7c6be5dad49450281f0f30681bfb8dd 2023-03-31 16:54:29,621 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120179e4c9cf55bf4b8cb0a65b4bef72a118 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120179e4c9cf55bf4b8cb0a65b4bef72a118 2023-03-31 16:54:29,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/83b3f377ee6848bd862aeb75db7c625c_SeqId_44_ 2023-03-31 16:54:29,623 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205722faf9121b64e589680e896b4cd6191 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205722faf9121b64e589680e896b4cd6191 2023-03-31 16:54:29,623 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-31 16:54:29,623 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-31 16:54:29,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:29,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:29,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:29,639 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:29,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.2830 sec 2023-03-31 16:54:29,652 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): ac187f8886d6480a15f5aa4cdc3a4bd3#family1#compaction#61 average throughput is 13.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:54:29,711 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/.tmp/family1/0c9dd0ba06cf4551baa2ffab28065696 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/0c9dd0ba06cf4551baa2ffab28065696 2023-03-31 16:54:29,721 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ac187f8886d6480a15f5aa4cdc3a4bd3/family1 of ac187f8886d6480a15f5aa4cdc3a4bd3 into 0c9dd0ba06cf4551baa2ffab28065696(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:29,721 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:29,722 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1680281669603; duration=0sec 2023-03-31 16:54:29,722 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:29,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/40e1b7aef9544a73b8a629662883b7cf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_] to archive 2023-03-31 16:54:29,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:29,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-31 16:54:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:29,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e55c09562d174d03bde0c19c3f4cacf3 2023-03-31 16:54:29,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/40e1b7aef9544a73b8a629662883b7cf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/40e1b7aef9544a73b8a629662883b7cf 2023-03-31 16:54:29,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/9c15f6d9a1db460fa6358f977ca060ee_SeqId_47_ 2023-03-31 16:54:29,794 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:29,796 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:29,796 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:29,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-31 16:54:29,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE}] 2023-03-31 16:54:29,807 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE 2023-03-31 16:54:29,808 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:29,808 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281669808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281669808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281669808"}]},"ts":"1680281669808"} 2023-03-31 16:54:29,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:29,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:29,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac187f8886d6480a15f5aa4cdc3a4bd3, disabling compactions & flushes 2023-03-31 16:54:29,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:29,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:29,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. after waiting 0 ms 2023-03-31 16:54:29,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:29,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-31 16:54:29,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:29,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:29,969 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: ac187f8886d6480a15f5aa4cdc3a4bd3 to self. 2023-03-31 16:54:29,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:29,972 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=CLOSED 2023-03-31 16:54:29,972 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281669972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281669972"}]},"ts":"1680281669972"} 2023-03-31 16:54:29,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-31 16:54:29,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369 in 163 msec 2023-03-31 16:54:29,975 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=true 2023-03-31 16:54:30,126 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:30,126 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281670126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281670126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281670126"}]},"ts":"1680281670126"} 2023-03-31 16:54:30,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:30,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:30,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac187f8886d6480a15f5aa4cdc3a4bd3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:30,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:30,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,286 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,287 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:30,287 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:30,287 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac187f8886d6480a15f5aa4cdc3a4bd3 columnFamilyName family1 2023-03-31 16:54:30,293 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/0c9dd0ba06cf4551baa2ffab28065696 2023-03-31 16:54:30,293 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(310): Store=ac187f8886d6480a15f5aa4cdc3a4bd3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:30,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:30,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac187f8886d6480a15f5aa4cdc3a4bd3; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68639523, jitterRate=0.02280859649181366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:30,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:30,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., pid=47, masterSystemTime=1680281670281 2023-03-31 16:54:30,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:30,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:30,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:30,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281670302"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281670302"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281670302"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281670302"}]},"ts":"1680281670302"} 2023-03-31 16:54:30,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-31 16:54:30,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369 in 175 msec 2023-03-31 16:54:30,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-31 16:54:30,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE in 499 msec 2023-03-31 16:54:30,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-31 16:54:30,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 509 msec 2023-03-31 16:54:30,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 537 msec 2023-03-31 16:54:30,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-31 16:54:30,314 INFO [Listener at localhost/38381] compactions.TestMobCompactor(278): alter status finished 2023-03-31 16:54:30,314 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:30,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:30,317 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:30,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:30,317 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282270317 2023-03-31 16:54:30,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:30,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-31 16:54:30,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:30,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x14487a9f to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:30,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce65fb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:30,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,375 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f604e389b1b14a83aa0495ce665d25a6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f604e389b1b14a83aa0495ce665d25a6 2023-03-31 16:54:30,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:30,394 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:30,395 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:30,410 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:30,413 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:30,429 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c2313d07231843bd831510449a5a37b9 first=Optional[r05] last=Optional[r8] 2023-03-31 16:54:30,430 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c2313d07231843bd831510449a5a37b9}] 2023-03-31 16:54:30,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c2313d07231843bd831510449a5a37b9 for inclusion in ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-31 16:54:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:30,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c2313d07231843bd831510449a5a37b9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sto2p2c70m6b9uqijafkjm3qge3b2h790d29bddi73hkrqqrhnv57cvlkcfel8ck/family1/c2313d07231843bd831510449a5a37b9 2023-03-31 16:54:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sto2p2c70m6b9uqijafkjm3qge3b2h790d29bddi73hkrqqrhnv57cvlkcfel8ck/family1/c2313d07231843bd831510449a5a37b9 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e6df4054641447718c76aa40d1e2ca63_SeqId_53_ 2023-03-31 16:54:30,451 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sto2p2c70m6b9uqijafkjm3qge3b2h790d29bddi73hkrqqrhnv57cvlkcfel8ck/family1/c2313d07231843bd831510449a5a37b9 into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e6df4054641447718c76aa40d1e2ca63_SeqId_53_ - updating store file list. 2023-03-31 16:54:30,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e6df4054641447718c76aa40d1e2ca63_SeqId_53_ into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:30,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sto2p2c70m6b9uqijafkjm3qge3b2h790d29bddi73hkrqqrhnv57cvlkcfel8ck/family1/c2313d07231843bd831510449a5a37b9 into ac187f8886d6480a15f5aa4cdc3a4bd3/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e6df4054641447718c76aa40d1e2ca63_SeqId_53_) 2023-03-31 16:54:30,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sto2p2c70m6b9uqijafkjm3qge3b2h790d29bddi73hkrqqrhnv57cvlkcfel8ck/family1/c2313d07231843bd831510449a5a37b9 2023-03-31 16:54:30,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:30,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:30,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0e49b39c81f401dbbf2c09a098bba8d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c0e49b39c81f401dbbf2c09a098bba8d 2023-03-31 16:54:30,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282e8f1fb8c89e4a40bd07c27e91481315 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282e8f1fb8c89e4a40bd07c27e91481315 2023-03-31 16:54:30,465 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-31 16:54:30,465 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-31 16:54:30,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:30,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:30,467 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:30,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 152 msec 2023-03-31 16:54:30,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:54:30,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:30,961 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-31 16:54:30,963 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:30,963 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-31 16:54:30,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-31 16:54:30,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE}] 2023-03-31 16:54:30,972 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE 2023-03-31 16:54:30,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:30,973 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281670973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281670973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281670973"}]},"ts":"1680281670973"} 2023-03-31 16:54:30,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:31,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac187f8886d6480a15f5aa4cdc3a4bd3, disabling compactions & flushes 2023-03-31 16:54:31,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. after waiting 0 ms 2023-03-31 16:54:31,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-31 16:54:31,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:31,132 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: ac187f8886d6480a15f5aa4cdc3a4bd3 to self. 2023-03-31 16:54:31,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=CLOSED 2023-03-31 16:54:31,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281671134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281671134"}]},"ts":"1680281671134"} 2023-03-31 16:54:31,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-31 16:54:31,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369 in 161 msec 2023-03-31 16:54:31,137 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=true 2023-03-31 16:54:31,288 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:31,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281671288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281671288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281671288"}]},"ts":"1680281671288"} 2023-03-31 16:54:31,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:31,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac187f8886d6480a15f5aa4cdc3a4bd3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:31,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:31,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,449 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,450 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:31,450 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1 2023-03-31 16:54:31,450 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac187f8886d6480a15f5aa4cdc3a4bd3 columnFamilyName family1 2023-03-31 16:54:31,457 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/0c9dd0ba06cf4551baa2ffab28065696 2023-03-31 16:54:31,461 DEBUG [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/family1/e6df4054641447718c76aa40d1e2ca63_SeqId_53_ 2023-03-31 16:54:31,461 INFO [StoreOpener-ac187f8886d6480a15f5aa4cdc3a4bd3-1] regionserver.HStore(310): Store=ac187f8886d6480a15f5aa4cdc3a4bd3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:31,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:54:31,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac187f8886d6480a15f5aa4cdc3a4bd3; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68867181, jitterRate=0.02620096504688263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:31,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:54:31,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3., pid=53, masterSystemTime=1680281671444 2023-03-31 16:54:31,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:54:31,470 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=ac187f8886d6480a15f5aa4cdc3a4bd3, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:31,470 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1680281671470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281671470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281671470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281671470"}]},"ts":"1680281671470"} 2023-03-31 16:54:31,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-31 16:54:31,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure ac187f8886d6480a15f5aa4cdc3a4bd3, server=jenkins-hbase4.apache.org,41157,1680281619369 in 179 msec 2023-03-31 16:54:31,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-31 16:54:31,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=ac187f8886d6480a15f5aa4cdc3a4bd3, REOPEN/MOVE in 502 msec 2023-03-31 16:54:31,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-31 16:54:31,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 507 msec 2023-03-31 16:54:31,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 941 msec 2023-03-31 16:54:31,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-31 16:54:31,482 INFO [Listener at localhost/38381] compactions.TestMobCompactor(278): alter status finished 2023-03-31 16:54:31,483 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-31 16:54:31,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:31,485 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:31,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:31,486 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282271486 2023-03-31 16:54:31,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:31,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-31 16:54:31,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:31,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x39698e1d to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:31,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17dc4544, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:31,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,495 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-31 16:54:31,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-31 16:54:31,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:31,498 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-31 16:54:31,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 14 msec 2023-03-31 16:54:31,552 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=260 (was 260), OpenFileDescriptor=637 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=385 (was 346) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3713 (was 3783) 2023-03-31 16:54:31,569 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=260, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=169, AvailableMemoryMB=3713 2023-03-31 16:54:31,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-31 16:54:31,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:31,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:31,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-31 16:54:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-31 16:54:31,588 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:31,592 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,593 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 empty. 2023-03-31 16:54:31,595 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-31 16:54:31,619 WARN [DataStreamer for file /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tmp/.tableinfo.0000000001] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-03-31 16:54:31,621 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:31,622 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 538db8bff598648ee8c34bd3a6524107, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 538db8bff598648ee8c34bd3a6524107, disabling compactions & flushes 2023-03-31 16:54:31,653 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. after waiting 0 ms 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:31,653 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:31,653 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:31,659 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:31,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281671660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281671660"}]},"ts":"1680281671660"} 2023-03-31 16:54:31,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:54:31,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:31,664 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281671664"}]},"ts":"1680281671664"} 2023-03-31 16:54:31,666 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-31 16:54:31,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, ASSIGN}] 2023-03-31 16:54:31,671 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, ASSIGN 2023-03-31 16:54:31,672 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:31,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-31 16:54:31,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:31,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281671823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281671823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281671823"}]},"ts":"1680281671823"} 2023-03-31 16:54:31,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:31,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-31 16:54:31,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:31,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 538db8bff598648ee8c34bd3a6524107, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:31,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:31,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,988 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,989 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:31,989 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:31,990 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 538db8bff598648ee8c34bd3a6524107 columnFamilyName family1 2023-03-31 16:54:31,992 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(310): Store=538db8bff598648ee8c34bd3a6524107/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:31,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:31,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:32,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:32,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:32,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 538db8bff598648ee8c34bd3a6524107; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65688508, jitterRate=-0.02116495370864868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:32,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:32,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., pid=57, masterSystemTime=1680281671983 2023-03-31 16:54:32,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:32,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:32,007 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,007 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281672007"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281672007"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281672007"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281672007"}]},"ts":"1680281672007"} 2023-03-31 16:54:32,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-31 16:54:32,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369 in 181 msec 2023-03-31 16:54:32,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-31 16:54:32,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, ASSIGN in 342 msec 2023-03-31 16:54:32,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:32,013 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281672013"}]},"ts":"1680281672013"} 2023-03-31 16:54:32,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-31 16:54:32,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:32,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 446 msec 2023-03-31 16:54:32,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-31 16:54:32,191 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-31 16:54:32,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:32,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,232 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:32,232 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:32,232 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:32,232 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:32,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,234 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:32,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:32,235 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,235 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,236 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,237 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:32,237 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:32,237 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:32,237 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:32,237 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:32,237 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:32,238 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:32,239 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:54:32,670 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c0dd16a167c24690af29c888ca45cd9b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0dd16a167c24690af29c888ca45cd9b 2023-03-31 16:54:32,674 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/bca40c42306148259b2f338b2b3904cc 2023-03-31 16:54:32,679 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/bca40c42306148259b2f338b2b3904cc as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc 2023-03-31 16:54:32,683 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-31 16:54:32,684 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 446ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:32,684 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:32,685 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:32,685 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:32,688 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:32,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:32,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49b92b70[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:32,691 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:32,691 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,693 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:32,695 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,695 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:32,697 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:32,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:32,701 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:32,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:32,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:32,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,701 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:32,703 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,703 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,703 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:32,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,704 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:32,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:32,714 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:32,714 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:32,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:32,815 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:32,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:32,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:32,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:32,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,821 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,823 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:32,823 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:32,824 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:32,824 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:32,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:32,825 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:32,825 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:32,825 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:32,825 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:32,825 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:32,825 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:32,825 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:32,825 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:54:33,247 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f16ae44488ae4c06bac3859333005963 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f16ae44488ae4c06bac3859333005963 2023-03-31 16:54:33,653 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/269288a4f2dc43cda307705d1f27941a 2023-03-31 16:54:33,658 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/269288a4f2dc43cda307705d1f27941a as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a 2023-03-31 16:54:33,663 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:54:33,664 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 839ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:33,664 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:33,664 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:33,666 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:33,667 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:33,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:33,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21fdff46[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:33,669 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:33,669 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,671 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,671 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:33,671 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:33,671 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:33,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:33,673 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,673 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:33,673 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:33,673 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:33,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:33,676 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:33,676 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:33,676 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:33,676 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,676 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:33,678 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,678 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,678 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:33,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:33,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:33,678 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:33,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,681 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:33,685 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:33,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:33,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:33,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,685 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:33,686 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:33,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:33,786 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:33,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:33,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:33,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:33,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,793 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:33,793 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:33,793 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:33,793 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:33,794 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,794 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,795 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,795 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:33,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:33,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:33,795 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:33,796 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,796 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,797 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:33,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:33,797 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:33,797 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:33,797 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:33,797 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:34,215 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015977759dded74b0ca672904290c70734 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015977759dded74b0ca672904290c70734 2023-03-31 16:54:34,621 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/596494571486484f980f59d4a3f625db 2023-03-31 16:54:34,625 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/596494571486484f980f59d4a3f625db as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db 2023-03-31 16:54:34,629 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db, entries=1, sequenceid=13, filesize=5.0 K 2023-03-31 16:54:34,629 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 832ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:34,629 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:34,629 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:34,631 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,631 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:34,631 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,631 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:34,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:34,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:34,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e92aef4[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:34,633 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:34,633 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,634 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,634 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:34,634 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:34,634 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:34,634 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,634 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:34,636 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:34,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:34,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:34,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:34,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:34,638 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:34,638 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:34,638 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:34,638 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,638 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:34,639 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,639 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,639 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:34,640 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,641 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,643 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:34,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:34,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:34,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:34,643 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:34,744 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:34,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:34,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,750 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:34,750 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:34,750 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:34,750 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:34,750 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,750 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,751 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,751 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:34,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:34,752 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:34,752 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,753 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:34,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:34,753 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:34,753 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:34,753 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:35,165 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120563a108bbb90a4a598994427422cb18d4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120563a108bbb90a4a598994427422cb18d4 2023-03-31 16:54:35,470 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:35,570 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/0d617e47622e41699b12771a7c28efe3 2023-03-31 16:54:35,575 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/0d617e47622e41699b12771a7c28efe3 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3 2023-03-31 16:54:35,579 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3, entries=1, sequenceid=17, filesize=5.0 K 2023-03-31 16:54:35,580 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 827ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:35,580 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:35,580 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:35,580 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:35,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:35,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:35,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9be9e6f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:35,585 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:35,585 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,586 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,586 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:35,586 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:35,586 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:35,586 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,586 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:35,590 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:35,590 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,590 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,590 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:35,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:35,592 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:35,592 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:35,592 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:35,592 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,592 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:35,594 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,594 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,594 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:35,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:35,595 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,596 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:35,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,598 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:35,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:35,598 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:35,698 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:35,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:35,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:35,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:35,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,704 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:35,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:35,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:35,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:35,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,705 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:35,706 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:35,707 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,707 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:35,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:35,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,708 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:35,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:35,708 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:35,708 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:35,708 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:35,708 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:35,708 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:35,708 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:35,708 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:35,709 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:36,126 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e6bb62d03d404f41aa0da35e2abbf049 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6bb62d03d404f41aa0da35e2abbf049 2023-03-31 16:54:36,531 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/412306a956264553ad804d7db03bdf4b 2023-03-31 16:54:36,536 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/412306a956264553ad804d7db03bdf4b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b 2023-03-31 16:54:36,539 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b, entries=1, sequenceid=21, filesize=5.0 K 2023-03-31 16:54:36,540 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 831ms, sequenceid=21, compaction requested=true 2023-03-31 16:54:36,540 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:36,540 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:36,540 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:36,541 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:36,541 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,541 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:36,541 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:36,543 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,543 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:36,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:36,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@95cc683[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:36,545 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:36,545 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,546 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:36,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:36,546 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:36,546 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:36,548 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:36,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:36,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:36,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:36,550 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:36,550 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:36,550 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:36,550 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,550 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:36,551 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,551 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:36,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,551 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:36,552 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,553 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:36,555 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:36,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:36,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:36,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:36,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,555 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:36,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:36,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:36,556 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:36,656 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:36,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:36,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:36,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,662 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:36,662 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:36,662 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:36,662 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:36,663 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,663 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,664 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,664 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:36,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:36,664 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:36,664 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,665 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,665 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:36,665 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:36,666 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:36,666 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:37,078 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b2591e4ab5148feaf02e955b80ccc24 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b2591e4ab5148feaf02e955b80ccc24 2023-03-31 16:54:37,483 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/4a8480d09e8a4a8fbe7d617c6417b7a5 2023-03-31 16:54:37,488 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/4a8480d09e8a4a8fbe7d617c6417b7a5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5 2023-03-31 16:54:37,491 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5, entries=1, sequenceid=25, filesize=5.0 K 2023-03-31 16:54:37,492 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 826ms, sequenceid=25, compaction requested=true 2023-03-31 16:54:37,492 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:37,492 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:37,492 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:37,492 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:37,492 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,492 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:37,492 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:37,494 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,494 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:37,494 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,494 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:37,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:37,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:37,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:37,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:37,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47951f21[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:37,496 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:37,496 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,497 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,497 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:37,497 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:37,497 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,497 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:37,497 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:37,499 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:37,499 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:37,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:37,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:37,501 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:37,501 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:37,501 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:37,501 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,501 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:37,502 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,502 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:37,502 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:37,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:37,503 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:37,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,504 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:37,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:37,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:37,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:37,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,509 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,509 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:37,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:37,510 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:37,610 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:37,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:37,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,616 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:37,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:37,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:37,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:37,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,616 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,621 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:37,621 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:37,622 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:37,622 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:37,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:37,623 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:37,623 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:37,623 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:37,623 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:37,623 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:37,623 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:37,623 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:37,623 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:38,034 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010100dc072e964a4c45b0d0d00edda430bf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc072e964a4c45b0d0d00edda430bf 2023-03-31 16:54:38,440 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/83a694d398be4a92a234407e6b539540 2023-03-31 16:54:38,444 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/83a694d398be4a92a234407e6b539540 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540 2023-03-31 16:54:38,447 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540, entries=1, sequenceid=29, filesize=5.0 K 2023-03-31 16:54:38,448 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 825ms, sequenceid=29, compaction requested=true 2023-03-31 16:54:38,448 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:38,448 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:38,448 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:38,448 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:38,448 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,448 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:38,448 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:38,450 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,450 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:38,450 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,450 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:38,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3bfc29[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:38,451 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:38,452 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,453 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:38,453 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,453 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:38,454 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,454 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:38,454 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:38,454 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:38,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:38,456 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:38,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:38,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:38,456 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,456 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:38,459 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,459 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:38,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,459 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:38,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:38,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:38,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:38,461 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,462 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,462 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:38,462 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:38,463 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:38,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:38,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:38,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,462 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:38,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:38,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:38,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,463 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,563 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:38,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:38,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,569 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:38,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:38,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:38,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:38,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,571 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:38,571 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:38,571 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:38,571 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:38,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:38,572 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:38,572 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:38,573 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:38,984 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038b3cfbf567eb4d03b43eb988fc332c8c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038b3cfbf567eb4d03b43eb988fc332c8c 2023-03-31 16:54:39,389 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/6bd8aab00d764c4b9f8e3cbf776f69af 2023-03-31 16:54:39,393 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/6bd8aab00d764c4b9f8e3cbf776f69af as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af 2023-03-31 16:54:39,397 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af, entries=1, sequenceid=33, filesize=5.0 K 2023-03-31 16:54:39,398 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 825ms, sequenceid=33, compaction requested=true 2023-03-31 16:54:39,398 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:39,398 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:39,398 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:39,398 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:39,398 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,398 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:39,398 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:39,399 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,399 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,400 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,400 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:39,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710b5627[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:39,401 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:39,401 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,403 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,403 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:39,403 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,403 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:39,403 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:39,403 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:39,405 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,405 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:39,405 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,405 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:39,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:39,407 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:39,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:39,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:39,407 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,407 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:39,409 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,409 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,409 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,409 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,410 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:39,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:39,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:39,412 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:39,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:39,412 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:39,413 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:39,413 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,413 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,413 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:39,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:39,413 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:39,513 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:39,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:39,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,519 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:39,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:39,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:39,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:39,520 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,520 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,522 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,522 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:39,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:39,522 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,522 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:39,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,523 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,523 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:39,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:39,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:39,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:39,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:39,523 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:39,523 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:39,523 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:39,523 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:39,935 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907842580443c284f1cb4053e8a65d3275d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907842580443c284f1cb4053e8a65d3275d 2023-03-31 16:54:39,941 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/6b2fddbedd62478690e71da98114c04e 2023-03-31 16:54:39,945 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/6b2fddbedd62478690e71da98114c04e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e 2023-03-31 16:54:39,950 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e, entries=1, sequenceid=37, filesize=5.0 K 2023-03-31 16:54:39,950 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 427ms, sequenceid=37, compaction requested=true 2023-03-31 16:54:39,951 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:39,951 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:39,952 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,952 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,953 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,953 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:39,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0cee5b[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:39,954 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:39,954 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,955 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:39,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,955 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:39,958 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,958 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:39,958 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,958 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:39,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:39,960 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:39,960 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:39,960 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:39,960 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,960 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:39,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,961 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:39,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,961 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:39,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,962 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,964 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:39,964 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:39,965 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:39,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:39,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:39,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:39,965 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,065 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:40,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:40,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:40,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:40,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,071 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:40,071 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:40,071 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-31 16:54:40,071 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-31 16:54:40,072 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,072 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,073 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:40,073 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,073 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,073 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:40,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-31 16:54:40,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,074 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-31 16:54:40,074 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:40,074 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-31 16:54:40,074 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:54:40,074 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:40,074 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:40,074 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. started... 2023-03-31 16:54:40,074 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 538db8bff598648ee8c34bd3a6524107 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:54:40,489 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120cc1f90f81b4d4aec8d47ed235a5d263f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120cc1f90f81b4d4aec8d47ed235a5d263f 2023-03-31 16:54:40,498 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/f0c6e02a3ce94a249ece98fa60dea07f 2023-03-31 16:54:40,504 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/f0c6e02a3ce94a249ece98fa60dea07f as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f 2023-03-31 16:54:40,508 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f, entries=1, sequenceid=41, filesize=5.0 K 2023-03-31 16:54:40,509 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 538db8bff598648ee8c34bd3a6524107 in 435ms, sequenceid=41, compaction requested=true 2023-03-31 16:54:40,509 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:40,509 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:54:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:54:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,509 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-31 16:54:40,510 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-31 16:54:40,511 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,511 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:40,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:40,511 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,511 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:40,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-31 16:54:40,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718f96ac[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:40,513 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-31 16:54:40,513 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,514 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,514 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-31 16:54:40,514 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-31 16:54:40,514 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:40,514 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,514 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:40,516 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-31 16:54:40,516 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:40,516 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,516 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-31 16:54:40,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:40,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-31 16:54:40,519 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-31 16:54:40,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:40,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:40,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,519 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:40,521 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,521 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,521 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:40,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:40,521 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,522 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,524 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,524 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,524 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,524 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:40,524 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:40,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:40,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-31 16:54:40,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:40,524 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:40,525 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:40,625 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:40,627 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:40,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:40,629 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:40,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:40,630 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282280630 2023-03-31 16:54:40,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:40,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-31 16:54:40,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:40,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x2b240a15 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:40,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16f9cc76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:40,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,471 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010339cdcab50ba241bcba67f673c96e0cae to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010339cdcab50ba241bcba67f673c96e0cae 2023-03-31 16:54:41,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:41,485 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:41,486 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:41,493 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:41,494 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:41,502 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/82334839a56346aeadb093da51c571a1 first=Optional[r3] last=Optional[r6] 2023-03-31 16:54:41,503 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/82334839a56346aeadb093da51c571a1}] 2023-03-31 16:54:41,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/82334839a56346aeadb093da51c571a1 for inclusion in 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:41,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-31 16:54:41,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:41,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:41,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/82334839a56346aeadb093da51c571a1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gm5785pr6far5lkdn4f3gjl2i8o078bc6eu9kvq3qm8n56qat1vc43mi109uj748/family1/82334839a56346aeadb093da51c571a1 2023-03-31 16:54:41,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gm5785pr6far5lkdn4f3gjl2i8o078bc6eu9kvq3qm8n56qat1vc43mi109uj748/family1/82334839a56346aeadb093da51c571a1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_ 2023-03-31 16:54:41,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gm5785pr6far5lkdn4f3gjl2i8o078bc6eu9kvq3qm8n56qat1vc43mi109uj748/family1/82334839a56346aeadb093da51c571a1 into 538db8bff598648ee8c34bd3a6524107/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_ - updating store file list. 2023-03-31 16:54:41,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_ into 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:41,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gm5785pr6far5lkdn4f3gjl2i8o078bc6eu9kvq3qm8n56qat1vc43mi109uj748/family1/82334839a56346aeadb093da51c571a1 into 538db8bff598648ee8c34bd3a6524107/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_) 2023-03-31 16:54:41,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gm5785pr6far5lkdn4f3gjl2i8o078bc6eu9kvq3qm8n56qat1vc43mi109uj748/family1/82334839a56346aeadb093da51c571a1 2023-03-31 16:54:41,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:54:41,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:54:41,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 538db8bff598648ee8c34bd3a6524107/family1 is initiating minor compaction 2023-03-31 16:54:41,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@74dd8020; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:41,521 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 538db8bff598648ee8c34bd3a6524107/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:41,521 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp, totalSize=50.3 K 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 269288a4f2dc43cda307705d1f27941a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 596494571486484f980f59d4a3f625db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 0d617e47622e41699b12771a7c28efe3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 412306a956264553ad804d7db03bdf4b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 4a8480d09e8a4a8fbe7d617c6417b7a5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 83a694d398be4a92a234407e6b539540, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 6bd8aab00d764c4b9f8e3cbf776f69af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 6b2fddbedd62478690e71da98114c04e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting f0c6e02a3ce94a249ece98fa60dea07f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:54:41,522 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:54:41,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:41,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:41,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6bb62d03d404f41aa0da35e2abbf049 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e6bb62d03d404f41aa0da35e2abbf049 2023-03-31 16:54:41,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b2591e4ab5148feaf02e955b80ccc24 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b2591e4ab5148feaf02e955b80ccc24 2023-03-31 16:54:41,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc072e964a4c45b0d0d00edda430bf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc072e964a4c45b0d0d00edda430bf 2023-03-31 16:54:41,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038b3cfbf567eb4d03b43eb988fc332c8c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038b3cfbf567eb4d03b43eb988fc332c8c 2023-03-31 16:54:41,530 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-31 16:54:41,530 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-31 16:54:41,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:41,564 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 538db8bff598648ee8c34bd3a6524107#family1#compaction#72 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:54:42,391 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/f03886c3aebc46ba99b6ed0c82cb40e0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f03886c3aebc46ba99b6ed0c82cb40e0 2023-03-31 16:54:42,391 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057022aa3da11e45adbd2a6a8ab2cd4f48 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057022aa3da11e45adbd2a6a8ab2cd4f48 2023-03-31 16:54:42,392 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:42,396 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 538db8bff598648ee8c34bd3a6524107/family1 of 538db8bff598648ee8c34bd3a6524107 into f03886c3aebc46ba99b6ed0c82cb40e0(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:42,396 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:42,396 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1680281681521; duration=0sec 2023-03-31 16:54:42,396 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:42,417 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 first=Optional[r00] last=Optional[r2] 2023-03-31 16:54:42,418 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21}] 2023-03-31 16:54:42,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 for inclusion in 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-31 16:54:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:42,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aacj04n9m3gljjfm3crg2qq7td6mchug3pmfscatqa0n0fte29rf5bs4d0nvkk6h/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 2023-03-31 16:54:42,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aacj04n9m3gljjfm3crg2qq7td6mchug3pmfscatqa0n0fte29rf5bs4d0nvkk6h/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_ 2023-03-31 16:54:42,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aacj04n9m3gljjfm3crg2qq7td6mchug3pmfscatqa0n0fte29rf5bs4d0nvkk6h/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 into 538db8bff598648ee8c34bd3a6524107/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_ - updating store file list. 2023-03-31 16:54:42,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_ into 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:42,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aacj04n9m3gljjfm3crg2qq7td6mchug3pmfscatqa0n0fte29rf5bs4d0nvkk6h/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 into 538db8bff598648ee8c34bd3a6524107/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_) 2023-03-31 16:54:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aacj04n9m3gljjfm3crg2qq7td6mchug3pmfscatqa0n0fte29rf5bs4d0nvkk6h/family1/cfdea8fc3d7a4e7c9575e0d7f31dbc21 2023-03-31 16:54:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:54:42,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:54:42,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 538db8bff598648ee8c34bd3a6524107/family1 is initiating minor compaction (all files) 2023-03-31 16:54:42,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@684aa60c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:42,431 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 538db8bff598648ee8c34bd3a6524107/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:42,432 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f03886c3aebc46ba99b6ed0c82cb40e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp, totalSize=388.1 K 2023-03-31 16:54:42,432 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting bca40c42306148259b2f338b2b3904cc, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:54:42,432 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting f03886c3aebc46ba99b6ed0c82cb40e0, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:54:42,433 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842768 2023-03-31 16:54:42,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:42,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:42,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0dd16a167c24690af29c888ca45cd9b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0dd16a167c24690af29c888ca45cd9b 2023-03-31 16:54:42,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015977759dded74b0ca672904290c70734 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015977759dded74b0ca672904290c70734 2023-03-31 16:54:42,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120563a108bbb90a4a598994427422cb18d4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120563a108bbb90a4a598994427422cb18d4 2023-03-31 16:54:42,437 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-31 16:54:42,437 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-31 16:54:42,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:42,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:42,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:42,439 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:42,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8110 sec 2023-03-31 16:54:42,447 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 538db8bff598648ee8c34bd3a6524107#family1#compaction#73 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:54:42,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_] to archive 2023-03-31 16:54:42,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:42,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/269288a4f2dc43cda307705d1f27941a 2023-03-31 16:54:42,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/596494571486484f980f59d4a3f625db 2023-03-31 16:54:42,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/0d617e47622e41699b12771a7c28efe3 2023-03-31 16:54:42,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/412306a956264553ad804d7db03bdf4b 2023-03-31 16:54:42,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/4a8480d09e8a4a8fbe7d617c6417b7a5 2023-03-31 16:54:42,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/83a694d398be4a92a234407e6b539540 2023-03-31 16:54:42,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6bd8aab00d764c4b9f8e3cbf776f69af 2023-03-31 16:54:42,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/6b2fddbedd62478690e71da98114c04e 2023-03-31 16:54:42,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f0c6e02a3ce94a249ece98fa60dea07f 2023-03-31 16:54:42,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d563f4bf0fc04f3aa238faf07e9db6d3_SeqId_44_ 2023-03-31 16:54:42,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-31 16:54:42,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:42,913 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:42,914 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:42,914 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:42,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-31 16:54:42,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE}] 2023-03-31 16:54:42,918 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE 2023-03-31 16:54:42,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:42,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281682919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281682919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281682919"}]},"ts":"1680281682919"} 2023-03-31 16:54:42,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:43,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 538db8bff598648ee8c34bd3a6524107, disabling compactions & flushes 2023-03-31 16:54:43,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,666 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/.tmp/family1/32006501d7d54d59b7082b665dec7bcb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/32006501d7d54d59b7082b665dec7bcb 2023-03-31 16:54:43,671 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 538db8bff598648ee8c34bd3a6524107/family1 of 538db8bff598648ee8c34bd3a6524107 into 32006501d7d54d59b7082b665dec7bcb(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:54:43,671 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:43,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. after waiting 0 ms 2023-03-31 16:54:43,671 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1680281682431; duration=1sec 2023-03-31 16:54:43,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,671 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:43,671 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f03886c3aebc46ba99b6ed0c82cb40e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_] to archive 2023-03-31 16:54:43,672 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:43,674 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/bca40c42306148259b2f338b2b3904cc 2023-03-31 16:54:43,675 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f03886c3aebc46ba99b6ed0c82cb40e0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/f03886c3aebc46ba99b6ed0c82cb40e0 2023-03-31 16:54:43,676 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/d79a3466fb8e40b5be0fba52590b56bd_SeqId_47_ 2023-03-31 16:54:43,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-31 16:54:43,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:43,681 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 538db8bff598648ee8c34bd3a6524107 to self. 2023-03-31 16:54:43,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,683 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=CLOSED 2023-03-31 16:54:43,683 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281683683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281683683"}]},"ts":"1680281683683"} 2023-03-31 16:54:43,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-31 16:54:43,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369 in 764 msec 2023-03-31 16:54:43,686 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=true 2023-03-31 16:54:43,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:43,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281683836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281683836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281683836"}]},"ts":"1680281683836"} 2023-03-31 16:54:43,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:43,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 538db8bff598648ee8c34bd3a6524107, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:43,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,994 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:43,995 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:43,995 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:43,996 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 538db8bff598648ee8c34bd3a6524107 columnFamilyName family1 2023-03-31 16:54:44,000 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/32006501d7d54d59b7082b665dec7bcb 2023-03-31 16:54:44,000 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(310): Store=538db8bff598648ee8c34bd3a6524107/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:44,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:44,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:44,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:44,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 538db8bff598648ee8c34bd3a6524107; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63767139, jitterRate=-0.04979558289051056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:44,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:44,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., pid=63, masterSystemTime=1680281683989 2023-03-31 16:54:44,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:44,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:44,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:44,008 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281684008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281684008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281684008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281684008"}]},"ts":"1680281684008"} 2023-03-31 16:54:44,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-31 16:54:44,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369 in 171 msec 2023-03-31 16:54:44,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-31 16:54:44,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE in 1.0930 sec 2023-03-31 16:54:44,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-31 16:54:44,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0960 sec 2023-03-31 16:54:44,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5110 sec 2023-03-31 16:54:44,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-31 16:54:44,017 INFO [Listener at localhost/38381] compactions.TestMobCompactor(278): alter status finished 2023-03-31 16:54:44,018 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:44,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:44,020 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:44,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:44,020 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282284020 2023-03-31 16:54:44,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:44,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-31 16:54:44,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2c422c to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:44,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c51dd2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:44,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,028 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,028 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,028 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,851 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112888355d431c2f47e082a984e383d8a573 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112888355d431c2f47e082a984e383d8a573 2023-03-31 16:54:44,852 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:44,866 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:44,867 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:44,874 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:44,876 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53496, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:44,883 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/621ecf8011094f71bc7ef8732c601837 first=Optional[r05] last=Optional[r8] 2023-03-31 16:54:44,884 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/621ecf8011094f71bc7ef8732c601837}] 2023-03-31 16:54:44,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/621ecf8011094f71bc7ef8732c601837 for inclusion in 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:44,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-31 16:54:44,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:44,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/621ecf8011094f71bc7ef8732c601837 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fg0lbgpfmbrv3dippf0ik07ncknvbjgc02uhrsc4encn0affehacn6s7q9rlcid8/family1/621ecf8011094f71bc7ef8732c601837 2023-03-31 16:54:44,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fg0lbgpfmbrv3dippf0ik07ncknvbjgc02uhrsc4encn0affehacn6s7q9rlcid8/family1/621ecf8011094f71bc7ef8732c601837 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/04ba9b2e773c4008876c6dd43b0f7847_SeqId_53_ 2023-03-31 16:54:44,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fg0lbgpfmbrv3dippf0ik07ncknvbjgc02uhrsc4encn0affehacn6s7q9rlcid8/family1/621ecf8011094f71bc7ef8732c601837 into 538db8bff598648ee8c34bd3a6524107/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/04ba9b2e773c4008876c6dd43b0f7847_SeqId_53_ - updating store file list. 2023-03-31 16:54:44,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/04ba9b2e773c4008876c6dd43b0f7847_SeqId_53_ into 538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:44,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fg0lbgpfmbrv3dippf0ik07ncknvbjgc02uhrsc4encn0affehacn6s7q9rlcid8/family1/621ecf8011094f71bc7ef8732c601837 into 538db8bff598648ee8c34bd3a6524107/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/04ba9b2e773c4008876c6dd43b0f7847_SeqId_53_) 2023-03-31 16:54:44,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fg0lbgpfmbrv3dippf0ik07ncknvbjgc02uhrsc4encn0affehacn6s7q9rlcid8/family1/621ecf8011094f71bc7ef8732c601837 2023-03-31 16:54:44,899 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:44,900 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:44,901 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120cc1f90f81b4d4aec8d47ed235a5d263f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120cc1f90f81b4d4aec8d47ed235a5d263f 2023-03-31 16:54:44,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f16ae44488ae4c06bac3859333005963 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f16ae44488ae4c06bac3859333005963 2023-03-31 16:54:44,902 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-31 16:54:44,902 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-31 16:54:44,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:44,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:44,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:44,904 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:44,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 885 msec 2023-03-31 16:54:44,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-31 16:54:44,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:44,969 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-31 16:54:44,970 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-31 16:54:44,970 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-31 16:54:44,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-31 16:54:44,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE}] 2023-03-31 16:54:44,974 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE 2023-03-31 16:54:44,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:44,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281684975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281684975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281684975"}]},"ts":"1680281684975"} 2023-03-31 16:54:44,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:45,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 538db8bff598648ee8c34bd3a6524107, disabling compactions & flushes 2023-03-31 16:54:45,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. after waiting 0 ms 2023-03-31 16:54:45,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-31 16:54:45,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:45,133 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 538db8bff598648ee8c34bd3a6524107 to self. 2023-03-31 16:54:45,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=CLOSED 2023-03-31 16:54:45,135 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281685135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281685135"}]},"ts":"1680281685135"} 2023-03-31 16:54:45,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-31 16:54:45,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369 in 160 msec 2023-03-31 16:54:45,138 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=true 2023-03-31 16:54:45,289 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:45,289 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281685289"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281685289"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281685289"}]},"ts":"1680281685289"} 2023-03-31 16:54:45,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:45,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 538db8bff598648ee8c34bd3a6524107, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,447 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,447 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:45,447 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1 2023-03-31 16:54:45,448 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 538db8bff598648ee8c34bd3a6524107 columnFamilyName family1 2023-03-31 16:54:45,452 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/04ba9b2e773c4008876c6dd43b0f7847_SeqId_53_ 2023-03-31 16:54:45,455 DEBUG [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/family1/32006501d7d54d59b7082b665dec7bcb 2023-03-31 16:54:45,456 INFO [StoreOpener-538db8bff598648ee8c34bd3a6524107-1] regionserver.HStore(310): Store=538db8bff598648ee8c34bd3a6524107/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:45,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:54:45,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 538db8bff598648ee8c34bd3a6524107; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69407116, jitterRate=0.034246623516082764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:54:45,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107., pid=69, masterSystemTime=1680281685442 2023-03-31 16:54:45,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:54:45,462 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=538db8bff598648ee8c34bd3a6524107, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:45,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1680281685462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281685462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281685462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281685462"}]},"ts":"1680281685462"} 2023-03-31 16:54:45,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-31 16:54:45,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 538db8bff598648ee8c34bd3a6524107, server=jenkins-hbase4.apache.org,41157,1680281619369 in 172 msec 2023-03-31 16:54:45,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-31 16:54:45,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=538db8bff598648ee8c34bd3a6524107, REOPEN/MOVE in 490 msec 2023-03-31 16:54:45,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-31 16:54:45,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-03-31 16:54:45,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 508 msec 2023-03-31 16:54:45,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-31 16:54:45,470 INFO [Listener at localhost/38381] compactions.TestMobCompactor(278): alter status finished 2023-03-31 16:54:45,470 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-31 16:54:45,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:45,472 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:45,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:45,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282285472 2023-03-31 16:54:45,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:54:45,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-31 16:54:45,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:45,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x2cc40360 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:45,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14439beb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-31 16:54:45,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-31 16:54:45,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:45,479 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-31 16:54:45,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 8 msec 2023-03-31 16:54:45,525 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=255 (was 260), OpenFileDescriptor=647 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 385), ProcessCount=169 (was 169), AvailableMemoryMB=3730 (was 3713) - AvailableMemoryMB LEAK? - 2023-03-31 16:54:45,535 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=255, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=169, AvailableMemoryMB=3730 2023-03-31 16:54:45,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-31 16:54:45,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:45,539 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:45,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-31 16:54:45,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:45,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:45,541 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:45,541 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 empty. 2023-03-31 16:54:45,542 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:45,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-31 16:54:45,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:45,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:45,949 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:45,950 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 779d3ab6652a6e53f58905a8477e1932, NAME => 'testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:46,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:46,355 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:46,355 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 779d3ab6652a6e53f58905a8477e1932, disabling compactions & flushes 2023-03-31 16:54:46,355 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,356 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,356 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. after waiting 0 ms 2023-03-31 16:54:46,356 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,356 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,356 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:46,358 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:46,359 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680281686359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281686359"}]},"ts":"1680281686359"} 2023-03-31 16:54:46,360 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:54:46,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:46,361 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281686361"}]},"ts":"1680281686361"} 2023-03-31 16:54:46,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-31 16:54:46,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, ASSIGN}] 2023-03-31 16:54:46,367 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, ASSIGN 2023-03-31 16:54:46,367 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:46,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=779d3ab6652a6e53f58905a8477e1932, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:46,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680281686518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281686518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281686518"}]},"ts":"1680281686518"} 2023-03-31 16:54:46,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 779d3ab6652a6e53f58905a8477e1932, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:46,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:46,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 779d3ab6652a6e53f58905a8477e1932, NAME => 'testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:54:46,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-31 16:54:46,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-31 16:54:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,678 INFO [StoreOpener-779d3ab6652a6e53f58905a8477e1932-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,679 DEBUG [StoreOpener-779d3ab6652a6e53f58905a8477e1932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1 2023-03-31 16:54:46,679 DEBUG [StoreOpener-779d3ab6652a6e53f58905a8477e1932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1 2023-03-31 16:54:46,679 INFO [StoreOpener-779d3ab6652a6e53f58905a8477e1932-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 779d3ab6652a6e53f58905a8477e1932 columnFamilyName f1 2023-03-31 16:54:46,681 INFO [StoreOpener-779d3ab6652a6e53f58905a8477e1932-1] regionserver.HStore(310): Store=779d3ab6652a6e53f58905a8477e1932/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:46,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:46,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 779d3ab6652a6e53f58905a8477e1932; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58782196, jitterRate=-0.12407702207565308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:54:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:46,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932., pid=73, masterSystemTime=1680281686671 2023-03-31 16:54:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:46,688 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=779d3ab6652a6e53f58905a8477e1932, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:46,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680281686688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281686688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281686688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281686688"}]},"ts":"1680281686688"} 2023-03-31 16:54:46,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-31 16:54:46,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 779d3ab6652a6e53f58905a8477e1932, server=jenkins-hbase4.apache.org,41157,1680281619369 in 170 msec 2023-03-31 16:54:46,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-31 16:54:46,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, ASSIGN in 326 msec 2023-03-31 16:54:46,693 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:46,693 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281686693"}]},"ts":"1680281686693"} 2023-03-31 16:54:46,694 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-31 16:54:46,697 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:46,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1590 sec 2023-03-31 16:54:47,517 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-31 16:54:47,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-31 16:54:47,646 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-31 16:54:47,646 DEBUG [Listener at localhost/38381] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-31 16:54:47,648 INFO [Listener at localhost/38381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-31 16:54:47,652 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-31 16:54:47,652 INFO [Listener at localhost/38381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-31 16:54:47,653 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-31 16:54:47,658 INFO [Listener at localhost/38381] regionserver.HRegion(2745): Flushing 779d3ab6652a6e53f58905a8477e1932 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-31 16:54:47,674 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331c26a55efa16d44d78cd5199272828904 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230331c26a55efa16d44d78cd5199272828904 2023-03-31 16:54:48,004 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-31 16:54:48,004 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-03-31 16:54:48,090 INFO [Listener at localhost/38381] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp/f1/a07ed89e28db4027b5ab18c10e480fbd 2023-03-31 16:54:48,095 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp/f1/a07ed89e28db4027b5ab18c10e480fbd as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd 2023-03-31 16:54:48,099 INFO [Listener at localhost/38381] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd, entries=1, sequenceid=5, filesize=4.9 K 2023-03-31 16:54:48,101 INFO [Listener at localhost/38381] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 779d3ab6652a6e53f58905a8477e1932 in 443ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:48,102 DEBUG [Listener at localhost/38381] regionserver.HRegion(2446): Flush status journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:48,104 INFO [Listener at localhost/38381] regionserver.HRegion(2745): Flushing 779d3ab6652a6e53f58905a8477e1932 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-31 16:54:48,517 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033110a80b2510214590b067ef20ac81a51c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033110a80b2510214590b067ef20ac81a51c 2023-03-31 16:54:48,522 INFO [Listener at localhost/38381] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp/f1/cc36306038c246c8846d968844606444 2023-03-31 16:54:48,526 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp/f1/cc36306038c246c8846d968844606444 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444 2023-03-31 16:54:48,530 INFO [Listener at localhost/38381] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444, entries=1, sequenceid=9, filesize=4.9 K 2023-03-31 16:54:48,531 INFO [Listener at localhost/38381] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 779d3ab6652a6e53f58905a8477e1932 in 427ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:48,531 DEBUG [Listener at localhost/38381] regionserver.HRegion(2446): Flush status journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:48,532 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-31 16:54:48,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-31 16:54:48,534 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-31 16:54:48,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:48,535 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282288535 2023-03-31 16:54:48,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:54:48,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-31 16:54:48,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-31 16:54:48,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7b9944 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:48,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@726fc923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:48,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230331 for table='testGetAfterCompaction' and column='f1' 2023-03-31 16:54:48,584 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,584 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,635 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,635 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,686 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,686 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,737 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,737 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,788 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,788 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,838 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,839 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,889 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,890 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,940 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,940 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,991 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:48,991 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,042 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,042 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,093 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,093 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,144 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,144 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,195 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,195 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,224 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:49,256 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:49,257 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c6cd804 to 127.0.0.1:57785 2023-03-31 16:54:49,257 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,257 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cc40360 to 127.0.0.1:57785 2023-03-31 16:54:49,257 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,257 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39698e1d to 127.0.0.1:57785 2023-03-31 16:54:49,257 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,257 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:49,257 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14487a9f to 127.0.0.1:57785 2023-03-31 16:54:49,257 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,257 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:49,258 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b240a15 to 127.0.0.1:57785 2023-03-31 16:54:49,258 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,258 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:54:49,258 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2c422c to 127.0.0.1:57785 2023-03-31 16:54:49,258 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:49,264 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,265 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,315 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,315 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,366 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,366 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,367 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033141b1e73bd0e2440194c044ebffc0a9d2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033141b1e73bd0e2440194c044ebffc0a9d2 2023-03-31 16:54:49,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testGetAfterCompaction' column='f1' 2023-03-31 16:54:49,381 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:49,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:49,389 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:54:49,392 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:54:49,402 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/f1/8774f682978542f0995a721f3855133d first=Optional[r1] last=Optional[r2] 2023-03-31 16:54:49,403 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/f1/8774f682978542f0995a721f3855133d}] 2023-03-31 16:54:49,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/f1/8774f682978542f0995a721f3855133d for inclusion in 779d3ab6652a6e53f58905a8477e1932/f1 2023-03-31 16:54:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-31 16:54:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:54:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:49,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/f1/8774f682978542f0995a721f3855133d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testGetAfterCompaction__d127gdtq9t53qso85qus6i8ojo7t023d3rs7btdk8lrij7b9436r0710u86vpt6f/f1/8774f682978542f0995a721f3855133d 2023-03-31 16:54:49,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testGetAfterCompaction__d127gdtq9t53qso85qus6i8ojo7t023d3rs7btdk8lrij7b9436r0710u86vpt6f/f1/8774f682978542f0995a721f3855133d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_ 2023-03-31 16:54:49,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testGetAfterCompaction__d127gdtq9t53qso85qus6i8ojo7t023d3rs7btdk8lrij7b9436r0710u86vpt6f/f1/8774f682978542f0995a721f3855133d into 779d3ab6652a6e53f58905a8477e1932/f1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_ - updating store file list. 2023-03-31 16:54:49,417 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680281689362; access_time=1680281688553; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-31 16:54:49,417 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,417 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_ into 779d3ab6652a6e53f58905a8477e1932/f1 2023-03-31 16:54:49,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testGetAfterCompaction__d127gdtq9t53qso85qus6i8ojo7t023d3rs7btdk8lrij7b9436r0710u86vpt6f/f1/8774f682978542f0995a721f3855133d into 779d3ab6652a6e53f58905a8477e1932/f1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_) 2023-03-31 16:54:49,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testGetAfterCompaction__d127gdtq9t53qso85qus6i8ojo7t023d3rs7btdk8lrij7b9436r0710u86vpt6f/f1/8774f682978542f0995a721f3855133d 2023-03-31 16:54:49,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 779d3ab6652a6e53f58905a8477e1932/f1 is initiating minor compaction 2023-03-31 16:54:49,421 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 779d3ab6652a6e53f58905a8477e1932/f1 in testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,421 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp, totalSize=10.0 K 2023-03-31 16:54:49,421 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting cc36306038c246c8846d968844606444, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:54:49,422 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:54:49,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7bc8d58; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:49,422 DEBUG [Listener at localhost/38381] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-31 16:54:49,428 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-31 16:54:49,429 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41157] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-31 16:54:49,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-31 16:54:49,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41157] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-31 16:54:49,429 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41157] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. because compaction request was cancelled 2023-03-31 16:54:49,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testGetAfterCompaction' column='f1' 2023-03-31 16:54:49,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:49,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033110a80b2510214590b067ef20ac81a51c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033110a80b2510214590b067ef20ac81a51c 2023-03-31 16:54:49,444 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230331c26a55efa16d44d78cd5199272828904 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230331c26a55efa16d44d78cd5199272828904 2023-03-31 16:54:49,444 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-31 16:54:49,444 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230331' 2023-03-31 16:54:49,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230331 for table='testGetAfterCompaction' and column='f1' 2023-03-31 16:54:49,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-31 16:54:49,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:54:49,447 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-31 16:54:49,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 914 msec 2023-03-31 16:54:49,452 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 779d3ab6652a6e53f58905a8477e1932#f1#compaction#76 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:54:49,480 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/.tmp/f1/1e65b97e23bd4ec1814ac6cd2001ede8 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8 2023-03-31 16:54:49,481 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680281689362; access_time=1680281688553; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-31 16:54:49,481 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680281689475; access_time=1680281689443; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,481 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,481 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,486 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 779d3ab6652a6e53f58905a8477e1932/f1 of 779d3ab6652a6e53f58905a8477e1932 into 1e65b97e23bd4ec1814ac6cd2001ede8(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:54:49,486 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:49,486 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1680281689421; duration=0sec 2023-03-31 16:54:49,486 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:54:49,532 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1680281689362; access_time=1680281688553; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-31 16:54:49,532 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680281689475; access_time=1680281689443; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,532 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,532 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688521; access_time=1680281688106; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_] to archive 2023-03-31 16:54:49,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:54:49,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/cc36306038c246c8846d968844606444 2023-03-31 16:54:49,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/0ac0bc9195f246b29bb0aef43d85ed62_SeqId_12_ 2023-03-31 16:54:49,583 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1680281689475; access_time=1680281689443; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,583 INFO [Listener at localhost/38381] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1680281688090; access_time=1680281687661; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-31 16:54:49,706 INFO [Listener at localhost/38381] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-31 16:54:49,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-31 16:54:49,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:49,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281689721"}]},"ts":"1680281689721"} 2023-03-31 16:54:49,723 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-31 16:54:49,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-31 16:54:49,731 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-31 16:54:49,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, UNASSIGN}] 2023-03-31 16:54:49,734 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, UNASSIGN 2023-03-31 16:54:49,734 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=779d3ab6652a6e53f58905a8477e1932, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:49,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680281689734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281689734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281689734"}]},"ts":"1680281689734"} 2023-03-31 16:54:49,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 779d3ab6652a6e53f58905a8477e1932, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:49,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-31 16:54:49,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:49,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 779d3ab6652a6e53f58905a8477e1932, disabling compactions & flushes 2023-03-31 16:54:49,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. after waiting 0 ms 2023-03-31 16:54:49,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-31 16:54:49,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-31 16:54:49,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932. 2023-03-31 16:54:49,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 779d3ab6652a6e53f58905a8477e1932: 2023-03-31 16:54:49,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:49,896 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=779d3ab6652a6e53f58905a8477e1932, regionState=CLOSED 2023-03-31 16:54:49,896 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1680281689896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281689896"}]},"ts":"1680281689896"} 2023-03-31 16:54:49,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-31 16:54:49,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 779d3ab6652a6e53f58905a8477e1932, server=jenkins-hbase4.apache.org,41157,1680281619369 in 161 msec 2023-03-31 16:54:49,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-31 16:54:49,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=779d3ab6652a6e53f58905a8477e1932, UNASSIGN in 167 msec 2023-03-31 16:54:49,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281689901"}]},"ts":"1680281689901"} 2023-03-31 16:54:49,902 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-31 16:54:49,905 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-31 16:54:49,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 192 msec 2023-03-31 16:54:50,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-31 16:54:50,026 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-31 16:54:50,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-31 16:54:50,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,040 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,042 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-31 16:54:50,046 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:50,048 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1, FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/recovered.edits] 2023-03-31 16:54:50,052 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/1e65b97e23bd4ec1814ac6cd2001ede8 2023-03-31 16:54:50,054 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/f1/a07ed89e28db4027b5ab18c10e480fbd 2023-03-31 16:54:50,056 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/recovered.edits/15.seqid to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932/recovered.edits/15.seqid 2023-03-31 16:54:50,057 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testGetAfterCompaction/779d3ab6652a6e53f58905a8477e1932 2023-03-31 16:54:50,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-31 16:54:50,058 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-31 16:54:50,061 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-31 16:54:50,065 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033141b1e73bd0e2440194c044ebffc0a9d2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023033141b1e73bd0e2440194c044ebffc0a9d2 2023-03-31 16:54:50,066 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-31 16:54:50,068 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,095 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-31 16:54:50,098 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-31 16:54:50,099 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,099 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-31 16:54:50,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680281690099"}]},"ts":"9223372036854775807"} 2023-03-31 16:54:50,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-31 16:54:50,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 779d3ab6652a6e53f58905a8477e1932, NAME => 'testGetAfterCompaction,,1680281685537.779d3ab6652a6e53f58905a8477e1932.', STARTKEY => '', ENDKEY => ''}] 2023-03-31 16:54:50,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-31 16:54:50,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1680281690101"}]},"ts":"9223372036854775807"} 2023-03-31 16:54:50,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-31 16:54:50,104 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-31 16:54:50,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 71 msec 2023-03-31 16:54:50,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-31 16:54:50,145 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-31 16:54:50,163 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 255), OpenFileDescriptor=600 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=386 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3689 (was 3730) 2023-03-31 16:54:50,176 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=386, ProcessCount=169, AvailableMemoryMB=3689 2023-03-31 16:54:50,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-31 16:54:50,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-31 16:54:50,181 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:54:50,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-31 16:54:50,182 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:54:50,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:50,196 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:50,197 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:50,199 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 empty. 2023-03-31 16:54:50,199 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:50,199 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a empty. 2023-03-31 16:54:50,201 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:50,201 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:50,202 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 empty. 2023-03-31 16:54:50,202 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:50,202 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-31 16:54:50,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:50,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:50,644 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-31 16:54:50,647 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => fd69f5667dfc09dd87ddcab179927c81, NAME => 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:50,647 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 25a5754dee8c6c40ad6587987233065a, NAME => 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:50,647 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9e84b76b45cb4571e5ae3c513a680551, NAME => 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:54:50,674 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:50,675 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 9e84b76b45cb4571e5ae3c513a680551, disabling compactions & flushes 2023-03-31 16:54:50,675 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:50,675 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:50,675 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. after waiting 0 ms 2023-03-31 16:54:50,675 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:50,675 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:50,675 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:50,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:50,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing fd69f5667dfc09dd87ddcab179927c81, disabling compactions & flushes 2023-03-31 16:54:50,689 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:50,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:50,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. after waiting 0 ms 2023-03-31 16:54:50,690 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:50,690 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:50,690 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:50,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 25a5754dee8c6c40ad6587987233065a, disabling compactions & flushes 2023-03-31 16:54:51,068 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. after waiting 0 ms 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,068 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,068 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:51,070 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:54:51,071 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281691071"}]},"ts":"1680281691071"} 2023-03-31 16:54:51,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281691071"}]},"ts":"1680281691071"} 2023-03-31 16:54:51,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281691071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281691071"}]},"ts":"1680281691071"} 2023-03-31 16:54:51,074 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-31 16:54:51,075 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:54:51,075 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281691075"}]},"ts":"1680281691075"} 2023-03-31 16:54:51,076 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-31 16:54:51,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN}] 2023-03-31 16:54:51,082 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN 2023-03-31 16:54:51,082 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN 2023-03-31 16:54:51,082 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:51,083 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:51,084 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN 2023-03-31 16:54:51,084 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:54:51,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,235 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,235 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281691234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281691234"}]},"ts":"1680281691234"} 2023-03-31 16:54:51,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281691234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281691234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281691234"}]},"ts":"1680281691234"} 2023-03-31 16:54:51,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281691234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281691234"}]},"ts":"1680281691234"} 2023-03-31 16:54:51,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:51,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:51,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:54:51,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:51,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:51,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e84b76b45cb4571e5ae3c513a680551, NAME => 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.', STARTKEY => '', ENDKEY => '1'} 2023-03-31 16:54:51,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:51,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,397 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,398 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:54:51,399 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:54:51,399 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e84b76b45cb4571e5ae3c513a680551 columnFamilyName family1 2023-03-31 16:54:51,400 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(310): Store=9e84b76b45cb4571e5ae3c513a680551/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,401 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,402 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2 2023-03-31 16:54:51,402 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2 2023-03-31 16:54:51,403 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e84b76b45cb4571e5ae3c513a680551 columnFamilyName family2 2023-03-31 16:54:51,404 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(310): Store=9e84b76b45cb4571e5ae3c513a680551/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:51,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:54:51,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:51,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e84b76b45cb4571e5ae3c513a680551; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66782695, jitterRate=-0.004860296845436096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:51,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:51,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., pid=85, masterSystemTime=1680281691392 2023-03-31 16:54:51,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:51,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:51,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd69f5667dfc09dd87ddcab179927c81, NAME => 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.', STARTKEY => '2', ENDKEY => ''} 2023-03-31 16:54:51,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:51,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281691414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281691414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281691414"}]},"ts":"1680281691414"} 2023-03-31 16:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,415 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,417 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:54:51,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-03-31 16:54:51,417 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:54:51,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369 in 176 msec 2023-03-31 16:54:51,417 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd69f5667dfc09dd87ddcab179927c81 columnFamilyName family1 2023-03-31 16:54:51,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN in 338 msec 2023-03-31 16:54:51,419 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(310): Store=fd69f5667dfc09dd87ddcab179927c81/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,420 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,421 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2 2023-03-31 16:54:51,421 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2 2023-03-31 16:54:51,421 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd69f5667dfc09dd87ddcab179927c81 columnFamilyName family2 2023-03-31 16:54:51,422 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(310): Store=fd69f5667dfc09dd87ddcab179927c81/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:51,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:54:51,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:51,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd69f5667dfc09dd87ddcab179927c81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68821622, jitterRate=0.025522083044052124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:51,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:51,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., pid=84, masterSystemTime=1680281691392 2023-03-31 16:54:51,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:51,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:51,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25a5754dee8c6c40ad6587987233065a, NAME => 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.', STARTKEY => '1', ENDKEY => '2'} 2023-03-31 16:54:51,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281691432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281691432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281691432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281691432"}]},"ts":"1680281691432"} 2023-03-31 16:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,433 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,435 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:54:51,435 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:54:51,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-31 16:54:51,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369 in 195 msec 2023-03-31 16:54:51,435 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a5754dee8c6c40ad6587987233065a columnFamilyName family1 2023-03-31 16:54:51,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN in 355 msec 2023-03-31 16:54:51,437 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(310): Store=25a5754dee8c6c40ad6587987233065a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,437 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,438 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2 2023-03-31 16:54:51,438 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2 2023-03-31 16:54:51,438 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a5754dee8c6c40ad6587987233065a columnFamilyName family2 2023-03-31 16:54:51,439 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(310): Store=25a5754dee8c6c40ad6587987233065a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:54:51,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:54:51,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:54:51,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:54:51,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25a5754dee8c6c40ad6587987233065a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61222003, jitterRate=-0.08772106468677521}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:54:51,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:51,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., pid=83, masterSystemTime=1680281691392 2023-03-31 16:54:51,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:51,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:51,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281691462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281691462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281691462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281691462"}]},"ts":"1680281691462"} 2023-03-31 16:54:51,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-03-31 16:54:51,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369 in 226 msec 2023-03-31 16:54:51,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-31 16:54:51,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN in 387 msec 2023-03-31 16:54:51,469 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:54:51,469 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281691469"}]},"ts":"1680281691469"} 2023-03-31 16:54:51,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-31 16:54:51,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:54:51,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2940 sec 2023-03-31 16:54:52,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-31 16:54:52,290 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-31 16:54:52,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:52,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:52,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:52,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:52,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-31 16:54:52,330 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-31 16:54:52,330 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:52,330 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-31 16:54:52,330 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-31 16:54:52,331 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:52,331 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:52,337 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:52,337 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:52,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:52,338 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:52,338 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:52,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:52,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-31 16:54:52,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-31 16:54:52,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-31 16:54:52,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:52,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-31 16:54:52,339 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:52,339 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:54:52,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:52,344 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9e84b76b45cb4571e5ae3c513a680551 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:54:52,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:54:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:52,345 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fd69f5667dfc09dd87ddcab179927c81 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:54:52,346 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:52,346 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:54:52,346 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 25a5754dee8c6c40ad6587987233065a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:54:52,415 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d 2023-03-31 16:54:52,809 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df 2023-03-31 16:54:52,813 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 2023-03-31 16:54:52,822 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/a8fdc977cd8f464cb8631da5d79471c7 2023-03-31 16:54:52,847 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638 2023-03-31 16:54:53,218 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/342cdd4c99a949d2a4a6c99a75647576 2023-03-31 16:54:53,222 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/7d016b1ab74143f69cfebc0afe48ed63 2023-03-31 16:54:53,235 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55 2023-03-31 16:54:53,255 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/1fe4fd3823524f7ebbbd90380e9de9e0 2023-03-31 16:54:53,260 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/a8fdc977cd8f464cb8631da5d79471c7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7 2023-03-31 16:54:53,265 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:54:53,265 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/1fe4fd3823524f7ebbbd90380e9de9e0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0 2023-03-31 16:54:53,270 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:54:53,271 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9e84b76b45cb4571e5ae3c513a680551 in 927ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:53,271 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-31 16:54:53,272 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:53,272 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:53,274 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:53,644 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/2a55d5512b194dcb92401775dd4578a2 2023-03-31 16:54:53,649 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3 2023-03-31 16:54:53,650 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/342cdd4c99a949d2a4a6c99a75647576 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576 2023-03-31 16:54:53,656 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/5caf3598d770477fa9ac83aa3b6439ca 2023-03-31 16:54:53,659 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:54:53,660 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/2a55d5512b194dcb92401775dd4578a2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2 2023-03-31 16:54:53,662 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/7d016b1ab74143f69cfebc0afe48ed63 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63 2023-03-31 16:54:53,666 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:54:53,667 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 25a5754dee8c6c40ad6587987233065a in 1321ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:53,669 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:53,669 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:53,669 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:53,670 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:54:53,671 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/5caf3598d770477fa9ac83aa3b6439ca as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca 2023-03-31 16:54:53,676 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:54:53,677 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fd69f5667dfc09dd87ddcab179927c81 in 1332ms, sequenceid=5, compaction requested=false 2023-03-31 16:54:53,677 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:53,677 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-31 16:54:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-31 16:54:53,681 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:53,681 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:53,682 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,682 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:53,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-31 16:54:53,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2286e600[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:53,684 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-31 16:54:53,684 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,685 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,685 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,685 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-31 16:54:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-31 16:54:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:53,687 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-31 16:54:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-31 16:54:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:53,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-31 16:54:53,690 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-31 16:54:53,691 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:53,691 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:53,691 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-31 16:54:53,691 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:53,692 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,692 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:53,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,692 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:53,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:53,693 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,694 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:53,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,698 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:53,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-31 16:54:53,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:53,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:53,698 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,699 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,699 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:53,699 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:53,699 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,699 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:53,799 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:53,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:53,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:53,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:53,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:53,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-31 16:54:53,809 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-31 16:54:53,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:53,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-31 16:54:53,809 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-31 16:54:53,810 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,810 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:53,811 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,811 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:53,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:53,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:53,811 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:53,811 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:53,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:53,812 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-31 16:54:53,813 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-31 16:54:53,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-31 16:54:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-31 16:54:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-31 16:54:53,813 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:53,813 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:54:53,813 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9e84b76b45cb4571e5ae3c513a680551 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:54:53,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:53,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:53,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:53,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:54:53,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:53,814 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:54:53,814 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fd69f5667dfc09dd87ddcab179927c81 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:54:53,814 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 25a5754dee8c6c40ad6587987233065a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:54:54,238 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 2023-03-31 16:54:54,242 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d 2023-03-31 16:54:54,250 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec 2023-03-31 16:54:54,256 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/8cf5ab6f2f7a48378b771244291b51f2 2023-03-31 16:54:54,286 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930 2023-03-31 16:54:54,649 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/089f982ec0764791998b4718fda389b0 2023-03-31 16:54:54,670 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/c65272a11ec546818124c29933577e70 2023-03-31 16:54:54,684 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f 2023-03-31 16:54:54,695 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/c9b46f4d37334e0c8a0d791188ac1135 2023-03-31 16:54:54,699 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/8cf5ab6f2f7a48378b771244291b51f2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2 2023-03-31 16:54:54,703 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:54:54,704 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/c9b46f4d37334e0c8a0d791188ac1135 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135 2023-03-31 16:54:54,708 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:54:54,709 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 25a5754dee8c6c40ad6587987233065a in 895ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:54,709 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:54,709 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:55,065 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0 2023-03-31 16:54:55,095 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/a36d51ab3b664ce9a9de4ff85b9e26ed 2023-03-31 16:54:55,099 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/c65272a11ec546818124c29933577e70 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70 2023-03-31 16:54:55,103 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:54:55,104 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/a36d51ab3b664ce9a9de4ff85b9e26ed as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed 2023-03-31 16:54:55,111 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:54:55,112 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9e84b76b45cb4571e5ae3c513a680551 in 1299ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:55,112 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:55,112 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:55,112 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:55,396 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:54:55,474 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/5636f88893104cf389826f6d8852d5c7 2023-03-31 16:54:55,480 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/089f982ec0764791998b4718fda389b0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0 2023-03-31 16:54:55,485 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:54:55,486 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/5636f88893104cf389826f6d8852d5c7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7 2023-03-31 16:54:55,498 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:54:55,499 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fd69f5667dfc09dd87ddcab179927c81 in 1685ms, sequenceid=9, compaction requested=false 2023-03-31 16:54:55,499 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:55,499 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-31 16:54:55,500 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-31 16:54:55,501 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:55,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-31 16:54:55,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9173619[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:55,504 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-31 16:54:55,504 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,505 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-31 16:54:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-31 16:54:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:55,506 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,506 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:55,508 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,508 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-31 16:54:55,508 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:55,508 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-31 16:54:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:55,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:55,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-31 16:54:55,511 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-31 16:54:55,511 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:55,511 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:55,511 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-31 16:54:55,511 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:55,514 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,514 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:55,514 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:55,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:55,515 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,516 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:55,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-31 16:54:55,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-31 16:54:55,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:55,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:55,520 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:55,519 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:55,519 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:55,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:55,620 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:55,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:55,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:55,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:55,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-31 16:54:55,628 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-31 16:54:55,628 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:55,628 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-31 16:54:55,628 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-31 16:54:55,632 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,632 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:55,634 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,634 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:55,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:55,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:55,635 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:55,635 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:55,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:55,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:55,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-31 16:54:55,636 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-31 16:54:55,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-31 16:54:55,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-31 16:54:55,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:55,636 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-31 16:54:55,637 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:55,637 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:54:55,637 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:55,637 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:55,638 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9e84b76b45cb4571e5ae3c513a680551 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:54:55,637 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:55,638 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:54:55,638 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:54:55,638 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 25a5754dee8c6c40ad6587987233065a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:54:55,638 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fd69f5667dfc09dd87ddcab179927c81 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:54:55,703 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb 2023-03-31 16:54:55,714 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 2023-03-31 16:54:56,116 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee 2023-03-31 16:54:56,126 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/2fc68a047a49448d8afc6e10984d961b 2023-03-31 16:54:56,126 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/d3691b4bd84c4c6994d32a91c0117304 2023-03-31 16:54:56,142 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd 2023-03-31 16:54:56,143 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437 2023-03-31 16:54:56,150 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/5aba3ec2f5c2419c984aaf749a0dc1bf 2023-03-31 16:54:56,154 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/d3691b4bd84c4c6994d32a91c0117304 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304 2023-03-31 16:54:56,158 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:54:56,159 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/5aba3ec2f5c2419c984aaf749a0dc1bf as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf 2023-03-31 16:54:56,162 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:54:56,163 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 25a5754dee8c6c40ad6587987233065a in 525ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:56,163 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:56,163 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:56,163 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:56,521 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/b544a161407c42689c0f25823bc34c18 2023-03-31 16:54:56,536 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b 2023-03-31 16:54:56,541 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/432df3e7594c4d5da5bb9da7957b58de 2023-03-31 16:54:56,545 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/b544a161407c42689c0f25823bc34c18 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18 2023-03-31 16:54:56,548 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:54:56,549 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/432df3e7594c4d5da5bb9da7957b58de as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de 2023-03-31 16:54:56,550 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/6d2dad366a9a4346b1e9a2504118efc6 2023-03-31 16:54:56,554 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:54:56,555 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/2fc68a047a49448d8afc6e10984d961b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b 2023-03-31 16:54:56,555 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9e84b76b45cb4571e5ae3c513a680551 in 917ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:56,555 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:56,555 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:56,558 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:54:56,559 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/6d2dad366a9a4346b1e9a2504118efc6 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6 2023-03-31 16:54:56,565 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:54:56,565 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fd69f5667dfc09dd87ddcab179927c81 in 927ms, sequenceid=13, compaction requested=true 2023-03-31 16:54:56,565 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:56,565 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-31 16:54:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-31 16:54:56,567 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-31 16:54:56,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70107f56[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:56,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-31 16:54:56,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,570 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-31 16:54:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-31 16:54:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-31 16:54:56,575 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,575 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:56,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-31 16:54:56,578 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-31 16:54:56,578 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:56,578 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:56,578 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-31 16:54:56,578 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:56,579 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:56,579 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,580 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:56,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:56,580 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,581 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:56,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:56,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:56,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:56,583 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,583 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:56,584 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-31 16:54:56,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:56,584 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:56,584 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:56,584 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:56,584 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:56,684 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:56,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:56,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:56,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:56,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:54:56,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:54:56,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-31 16:54:56,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-31 16:54:56,699 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-31 16:54:56,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:56,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-31 16:54:56,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-31 16:54:56,700 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,700 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:56,701 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:56,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:56,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:56,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:56,701 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:56,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:56,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-31 16:54:56,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-31 16:54:56,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-31 16:54:56,702 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-31 16:54:56,702 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:54:56,702 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-31 16:54:56,703 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:56,703 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:54:56,703 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:56,703 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:54:56,703 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9e84b76b45cb4571e5ae3c513a680551 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:54:56,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:54:56,703 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:54:56,703 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fd69f5667dfc09dd87ddcab179927c81 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:54:56,703 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:56,704 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:54:56,704 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 25a5754dee8c6c40ad6587987233065a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:54:56,738 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad 2023-03-31 16:54:56,745 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/64cc88fb3e86442c8e05095c9ea5e690 2023-03-31 16:54:56,767 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675 2023-03-31 16:54:56,780 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/7a55308a90fe411f82bc9508c93f8888 2023-03-31 16:54:56,785 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/64cc88fb3e86442c8e05095c9ea5e690 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690 2023-03-31 16:54:56,789 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:54:56,790 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/7a55308a90fe411f82bc9508c93f8888 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888 2023-03-31 16:54:56,794 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:54:56,795 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9e84b76b45cb4571e5ae3c513a680551 in 92ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:56,795 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:56,795 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:56,795 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:54:57,139 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 2023-03-31 16:54:57,143 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa 2023-03-31 16:54:57,157 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/bc4a4feee3824797b7d20832b9a19dcc 2023-03-31 16:54:57,170 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830 2023-03-31 16:54:57,175 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 2023-03-31 16:54:57,179 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/bc4a4feee3824797b7d20832b9a19dcc as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc 2023-03-31 16:54:57,185 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:54:57,185 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 2023-03-31 16:54:57,199 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:54:57,200 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fd69f5667dfc09dd87ddcab179927c81 in 497ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:57,200 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:57,200 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:57,200 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:54:57,555 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 2023-03-31 16:54:57,970 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897 2023-03-31 16:54:57,975 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/0c64467471a64d57bc2a2b24fbc97e2d 2023-03-31 16:54:57,980 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 2023-03-31 16:54:57,983 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:54:57,984 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/0c64467471a64d57bc2a2b24fbc97e2d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d 2023-03-31 16:54:57,987 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:54:57,988 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 25a5754dee8c6c40ad6587987233065a in 1284ms, sequenceid=17, compaction requested=true 2023-03-31 16:54:57,988 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:57,988 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:54:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:54:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-31 16:54:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-31 16:54:57,992 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:57,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-31 16:54:57,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7da7bd0e[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:57,994 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-31 16:54:57,994 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,995 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:57,995 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-31 16:54:57,995 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-31 16:54:57,995 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:57,995 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,995 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:57,996 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:57,999 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-31 16:54:57,999 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:57,999 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:57,999 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-31 16:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-31 16:54:57,999 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:54:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-31 16:54:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-31 16:54:58,001 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:54:58,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:58,002 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:58,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:58,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:58,003 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:58,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,004 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-31 16:54:58,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:58,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:54:58,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,011 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:54:58,011 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:54:58,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:54:58,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,012 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:58,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-31 16:54:58,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:58,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:54:58,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:54:58,012 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:54:58,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-31 16:54:58,113 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:54:58,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:54:58,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:54:58,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680281698127 (current time:1680281698127). 2023-03-31 16:54:58,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-31 16:54:58,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] zookeeper.ReadOnlyZKClient(139): Connect 0x7e10d9af to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:54:58,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3abe5eb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:54:58,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:54:58,143 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:54:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e10d9af to 127.0.0.1:57785 2023-03-31 16:54:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:54:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-31 16:54:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:54:58,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:54:58,155 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:54:58,156 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680282298156 2023-03-31 16:54:58,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:54:58,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1680281698114 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-31 16:54:58,157 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:54:58,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-31 16:54:58,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-31 16:54:58,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-31 16:54:58,159 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1680282298159 2023-03-31 16:54:58,161 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-31 16:54:58,162 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-31 16:54:58,262 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:54:58,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:54:58,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:54:58,267 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-31 16:54:58,467 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:54:58,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:54:58,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:54:58,468 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-31 16:54:58,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1680281698114 2023-03-31 16:54:58,567 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1680281698114' 2023-03-31 16:54:58,567 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-31 16:54:58,568 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1680281698114' starting 'acquire' 2023-03-31 16:54:58,568 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1680281698114', kicking off acquire phase on members. 2023-03-31 16:54:58,568 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:58,568 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1680281698114 2023-03-31 16:54:58,569 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-31 16:54:58,569 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-31 16:54:58,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-31 16:54:58,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,570 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:54:58,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1680281698114 2023-03-31 16:54:58,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:58,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-31 16:54:58,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1680281698114 2023-03-31 16:54:58,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1680281698114 from table testCompactionWithHFileLink type FLUSH 2023-03-31 16:54:58,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1680281698114 2023-03-31 16:54:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1680281698114' with timeout 300000ms 2023-03-31 16:54:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-31 16:54:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1680281698114' starting 'acquire' stage 2023-03-31 16:54:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1680281698114' locally acquired 2023-03-31 16:54:58,574 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (snaptb-1680281698114) in zk 2023-03-31 16:54:58,576 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,576 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:58,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-31 16:54:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:58,577 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,577 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1680281698114' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:54:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:58,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'snaptb-1680281698114' on coordinator 2023-03-31 16:54:58,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6804f25c[Count = 0] remaining members to acquire global barrier 2023-03-31 16:54:58,578 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1680281698114' starting 'in-barrier' execution. 2023-03-31 16:54:58,578 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,579 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:58,579 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1680281698114' received 'reached' from coordinator. 2023-03-31 16:54:58,580 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:58,580 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:54:58,582 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.' region-info for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,582 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.' region-info for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,588 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-31 16:54:58,588 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-31 16:54:58,588 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:58,588 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:54:58,588 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:54:58,589 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.' region-info for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,589 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-31 16:54:58,588 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-31 16:54:58,592 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc] hfiles 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690] hfiles 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1] hfiles 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,593 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888] hfiles 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2] hfiles 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d] hfiles 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,598 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,598 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 for snapshot=snaptb-1680281698114 2023-03-31 16:54:58,620 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. completed. 2023-03-31 16:54:58,620 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:54:58,621 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-31 16:54:58,638 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. completed. 2023-03-31 16:54:58,638 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:54:58,638 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-31 16:54:58,769 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:54:58,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:54:58,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:54:58,770 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-31 16:54:59,034 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. completed. 2023-03-31 16:54:59,034 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-31 16:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-31 16:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1680281698114' locally completed 2023-03-31 16:54:59,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1680281698114' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:54:59,037 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1680281698114' has notified controller of completion 2023-03-31 16:54:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-31 16:54:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1680281698114' completed. 2023-03-31 16:54:59,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:59,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1680281698114' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:54:59,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'snaptb-1680281698114', counting down latch. Waiting for 0 more 2023-03-31 16:54:59,040 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1680281698114' execution completed 2023-03-31 16:54:59,040 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:54:59,040 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:54:59,040 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1680281698114 2023-03-31 16:54:59,040 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1680281698114including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-31 16:54:59,042 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:54:59,042 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-31 16:54:59,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,042 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-31 16:54:59,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-31 16:54:59,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:54:59,043 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:59,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:54:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:59,044 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:54:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1680281698114 2023-03-31 16:54:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680281698114 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1680281698114 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680281698114/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:54:59,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-31 16:54:59,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-31 16:54:59,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1680281698114 2023-03-31 16:54:59,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1680281698114 because node does not exist (not an error) 2023-03-31 16:54:59,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-31 16:54:59,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1680281698114 2023-03-31 16:54:59,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-31 16:54:59,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-31 16:54:59,046 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:54:59,046 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:59,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-31 16:54:59,047 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1680281698114 2023-03-31 16:54:59,047 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1680281698114 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d] mob files 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec 2023-03-31 16:54:59,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675] mob files 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f 2023-03-31 16:54:59,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675 2023-03-31 16:54:59,270 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:54:59,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:54:59,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:54:59,272 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-31 16:54:59,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1680281698114 2023-03-31 16:54:59,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/snaptb-1680281698114 2023-03-31 16:54:59,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/snaptb-1680281698114 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/snaptb-1680281698114 2023-03-31 16:54:59,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1680281698114 of table testCompactionWithHFileLink completed 2023-03-31 16:54:59,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/snaptb-1680281698114 2023-03-31 16:54:59,642 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/snaptb-1680281698114 2023-03-31 16:54:59,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1680281698114 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680281698156Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1680281699457 (+1301 ms)Consolidate snapshot: snaptb-1680281698114 at 1680281699457Loading Region manifests for snaptb-1680281698114 at 1680281699457Writing data manifest for snaptb-1680281698114 at 1680281699483 (+26 ms)Verifying snapshot: snaptb-1680281698114 at 1680281699495 (+12 ms)Snapshot snaptb-1680281698114 of table testCompactionWithHFileLink completed at 1680281699641 (+146 ms) 2023-03-31 16:54:59,643 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-31 16:54:59,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.4860 sec 2023-03-31 16:55:00,272 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:00,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:00,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-31 16:55:00,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-31 16:55:00,315 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-31 16:55:00,316 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:00,316 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-31 16:55:00,316 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-31 16:55:00,316 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:00,316 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:55:00,318 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:00,318 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:00,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:00,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:00,318 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:00,318 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:00,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:55:00,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:55:00,319 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-31 16:55:00,319 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-31 16:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-31 16:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-31 16:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-31 16:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. started... 2023-03-31 16:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:00,320 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. started... 2023-03-31 16:55:00,320 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. started... 2023-03-31 16:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:00,320 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fd69f5667dfc09dd87ddcab179927c81 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:00,320 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 25a5754dee8c6c40ad6587987233065a 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:00,320 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9e84b76b45cb4571e5ae3c513a680551 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:00,746 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/48c75a0d73d8408f8f67e064d890f501 2023-03-31 16:55:00,750 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48c75a0d73d8408f8f67e064d890f501 2023-03-31 16:55:00,762 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/38b0cbf4442842658f1d217f4ea86f58 2023-03-31 16:55:00,770 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38b0cbf4442842658f1d217f4ea86f58 2023-03-31 16:55:01,142 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/45298dcbb52044089c2cc00d7174ac17 2023-03-31 16:55:01,146 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45298dcbb52044089c2cc00d7174ac17 2023-03-31 16:55:01,585 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/be61d0f23cea4b4f87e047613aa470f4 2023-03-31 16:55:01,589 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be61d0f23cea4b4f87e047613aa470f4 2023-03-31 16:55:01,590 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/48c75a0d73d8408f8f67e064d890f501 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501 2023-03-31 16:55:01,594 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48c75a0d73d8408f8f67e064d890f501 2023-03-31 16:55:01,594 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501, entries=3, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,595 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/be61d0f23cea4b4f87e047613aa470f4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4 2023-03-31 16:55:01,596 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/0c230ed18cb548c086160d022de86a7c 2023-03-31 16:55:01,600 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be61d0f23cea4b4f87e047613aa470f4 2023-03-31 16:55:01,600 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4, entries=1, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,600 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c230ed18cb548c086160d022de86a7c 2023-03-31 16:55:01,601 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fd69f5667dfc09dd87ddcab179927c81 in 1281ms, sequenceid=24, compaction requested=true 2023-03-31 16:55:01,601 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:01,601 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:01,601 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/38b0cbf4442842658f1d217f4ea86f58 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58 2023-03-31 16:55:01,601 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:01,613 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38b0cbf4442842658f1d217f4ea86f58 2023-03-31 16:55:01,613 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58, entries=3, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,614 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/0c230ed18cb548c086160d022de86a7c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c 2023-03-31 16:55:01,618 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c230ed18cb548c086160d022de86a7c 2023-03-31 16:55:01,618 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c, entries=1, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,619 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9e84b76b45cb4571e5ae3c513a680551 in 1299ms, sequenceid=24, compaction requested=true 2023-03-31 16:55:01,619 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:01,619 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:01,619 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:01,962 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/2336b33a83074d30aeeb7d1594803712 2023-03-31 16:55:01,968 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2336b33a83074d30aeeb7d1594803712 2023-03-31 16:55:01,969 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/45298dcbb52044089c2cc00d7174ac17 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17 2023-03-31 16:55:01,974 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45298dcbb52044089c2cc00d7174ac17 2023-03-31 16:55:01,975 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17, entries=3, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,975 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/2336b33a83074d30aeeb7d1594803712 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712 2023-03-31 16:55:01,980 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2336b33a83074d30aeeb7d1594803712 2023-03-31 16:55:01,980 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712, entries=1, sequenceid=24, filesize=5.0 K 2023-03-31 16:55:01,982 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 25a5754dee8c6c40ad6587987233065a in 1662ms, sequenceid=24, compaction requested=true 2023-03-31 16:55:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-31 16:55:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-31 16:55:01,984 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,984 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:01,985 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,985 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:01,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-31 16:55:01,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5813b6bb[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:01,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-31 16:55:01,986 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:01,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-31 16:55:01,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-31 16:55:01,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:01,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:01,994 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-31 16:55:01,994 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:01,994 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,994 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-31 16:55:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:01,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-31 16:55:01,997 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-31 16:55:01,997 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:01,997 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:01,997 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-31 16:55:01,997 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:01,998 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:01,998 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:01,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:01,998 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:01,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:01,999 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:02,001 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:02,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:02,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:02,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:02,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-31 16:55:02,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:02,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:02,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:02,004 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:02,004 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-31 16:55:02,005 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:02,005 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:02,005 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-31 16:55:02,005 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-31 16:55:02,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-31 16:55:02,105 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:02,106 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:02,106 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 9e84b76b45cb4571e5ae3c513a680551/family1 is initiating major compaction (all files) 2023-03-31 16:55:02,107 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:02,107 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:02,107 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 9e84b76b45cb4571e5ae3c513a680551/family1 in testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:02,107 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp, totalSize=26.7 K 2023-03-31 16:55:02,108 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting a8fdc977cd8f464cb8631da5d79471c7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692309 2023-03-31 16:55:02,108 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting c65272a11ec546818124c29933577e70, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:02,108 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b544a161407c42689c0f25823bc34c18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:02,109 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 64cc88fb3e86442c8e05095c9ea5e690, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696686 2023-03-31 16:55:02,109 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 38b0cbf4442842658f1d217f4ea86f58, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:02,127 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 9e84b76b45cb4571e5ae3c513a680551#family1#compaction#107 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:02,134 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del 2023-03-31 16:55:02,134 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del 2023-03-31 16:55:02,550 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd2be47922ec43718f0a435f20d04f5b 2023-03-31 16:55:02,551 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/fd2be47922ec43718f0a435f20d04f5b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/fd2be47922ec43718f0a435f20d04f5b 2023-03-31 16:55:02,555 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd2be47922ec43718f0a435f20d04f5b 2023-03-31 16:55:02,556 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9e84b76b45cb4571e5ae3c513a680551/family1 of 9e84b76b45cb4571e5ae3c513a680551 into fd2be47922ec43718f0a435f20d04f5b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:02,556 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:02,556 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:02,556 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 9e84b76b45cb4571e5ae3c513a680551/family2 is initiating major compaction (all files) 2023-03-31 16:55:02,556 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:02,556 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:02,557 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 9e84b76b45cb4571e5ae3c513a680551/family2 in testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:02,557 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp, totalSize=25.4 K 2023-03-31 16:55:02,558 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 1fe4fd3823524f7ebbbd90380e9de9e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692309 2023-03-31 16:55:02,558 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting a36d51ab3b664ce9a9de4ff85b9e26ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:02,558 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 432df3e7594c4d5da5bb9da7957b58de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:02,559 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 7a55308a90fe411f82bc9508c93f8888, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696686 2023-03-31 16:55:02,559 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 0c230ed18cb548c086160d022de86a7c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:02,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58] to archive 2023-03-31 16:55:02,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:02,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/a8fdc977cd8f464cb8631da5d79471c7 2023-03-31 16:55:02,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/c65272a11ec546818124c29933577e70 2023-03-31 16:55:02,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/b544a161407c42689c0f25823bc34c18 2023-03-31 16:55:02,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/64cc88fb3e86442c8e05095c9ea5e690 2023-03-31 16:55:02,581 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 9e84b76b45cb4571e5ae3c513a680551#family2#compaction#108 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:02,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/38b0cbf4442842658f1d217f4ea86f58 2023-03-31 16:55:02,999 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del 2023-03-31 16:55:02,999 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del 2023-03-31 16:55:03,014 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbe1f38aae64a1cb73d2b13786003fb 2023-03-31 16:55:03,015 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/2dbe1f38aae64a1cb73d2b13786003fb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/2dbe1f38aae64a1cb73d2b13786003fb 2023-03-31 16:55:03,019 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbe1f38aae64a1cb73d2b13786003fb 2023-03-31 16:55:03,020 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9e84b76b45cb4571e5ae3c513a680551/family2 of 9e84b76b45cb4571e5ae3c513a680551 into 2dbe1f38aae64a1cb73d2b13786003fb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:03,020 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:03,020 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:03,020 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): fd69f5667dfc09dd87ddcab179927c81/family1 is initiating major compaction (all files) 2023-03-31 16:55:03,020 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:03,020 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:03,021 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of fd69f5667dfc09dd87ddcab179927c81/family1 in testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:03,021 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp, totalSize=26.7 K 2023-03-31 16:55:03,022 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 7d016b1ab74143f69cfebc0afe48ed63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692311 2023-03-31 16:55:03,022 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 089f982ec0764791998b4718fda389b0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:03,022 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 2fc68a047a49448d8afc6e10984d961b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:03,023 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting bc4a4feee3824797b7d20832b9a19dcc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:03,023 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 48c75a0d73d8408f8f67e064d890f501, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:03,035 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): fd69f5667dfc09dd87ddcab179927c81#family1#compaction#109 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:03,043 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del 2023-03-31 16:55:03,043 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del 2023-03-31 16:55:03,057 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d08134095c40799623fca5d375b647 2023-03-31 16:55:03,058 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/e0d08134095c40799623fca5d375b647 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/e0d08134095c40799623fca5d375b647 2023-03-31 16:55:03,062 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0d08134095c40799623fca5d375b647 2023-03-31 16:55:03,063 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd69f5667dfc09dd87ddcab179927c81/family1 of fd69f5667dfc09dd87ddcab179927c81 into e0d08134095c40799623fca5d375b647(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:03,063 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:03,063 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:03,063 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): fd69f5667dfc09dd87ddcab179927c81/family2 is initiating major compaction (all files) 2023-03-31 16:55:03,064 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:03,064 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:03,064 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of fd69f5667dfc09dd87ddcab179927c81/family2 in testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:03,064 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp, totalSize=25.4 K 2023-03-31 16:55:03,068 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 5caf3598d770477fa9ac83aa3b6439ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692311 2023-03-31 16:55:03,069 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 5636f88893104cf389826f6d8852d5c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:03,070 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 6d2dad366a9a4346b1e9a2504118efc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:03,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c] to archive 2023-03-31 16:55:03,070 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 4ea0b7bad52e4a9c9492ccbaf8d94bc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:03,070 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting be61d0f23cea4b4f87e047613aa470f4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:03,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:03,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/1fe4fd3823524f7ebbbd90380e9de9e0 2023-03-31 16:55:03,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/a36d51ab3b664ce9a9de4ff85b9e26ed 2023-03-31 16:55:03,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/432df3e7594c4d5da5bb9da7957b58de 2023-03-31 16:55:03,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/7a55308a90fe411f82bc9508c93f8888 2023-03-31 16:55:03,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/0c230ed18cb548c086160d022de86a7c 2023-03-31 16:55:03,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501] to archive 2023-03-31 16:55:03,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:03,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/7d016b1ab74143f69cfebc0afe48ed63 2023-03-31 16:55:03,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/089f982ec0764791998b4718fda389b0 2023-03-31 16:55:03,091 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): fd69f5667dfc09dd87ddcab179927c81#family2#compaction#110 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:03,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/2fc68a047a49448d8afc6e10984d961b 2023-03-31 16:55:03,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/bc4a4feee3824797b7d20832b9a19dcc 2023-03-31 16:55:03,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/48c75a0d73d8408f8f67e064d890f501 2023-03-31 16:55:03,107 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del 2023-03-31 16:55:03,108 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del 2023-03-31 16:55:03,507 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:55:03,545 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f3b016b3b854eb0b4935a49d8217a83 2023-03-31 16:55:03,546 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/9f3b016b3b854eb0b4935a49d8217a83 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/9f3b016b3b854eb0b4935a49d8217a83 2023-03-31 16:55:03,551 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f3b016b3b854eb0b4935a49d8217a83 2023-03-31 16:55:03,552 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd69f5667dfc09dd87ddcab179927c81/family2 of fd69f5667dfc09dd87ddcab179927c81 into 9f3b016b3b854eb0b4935a49d8217a83(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:03,552 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:03,553 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:03,553 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 25a5754dee8c6c40ad6587987233065a/family1 is initiating major compaction (all files) 2023-03-31 16:55:03,553 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:03,553 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:03,554 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 25a5754dee8c6c40ad6587987233065a/family1 in testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:03,555 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp, totalSize=26.7 K 2023-03-31 16:55:03,555 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 342cdd4c99a949d2a4a6c99a75647576, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692310 2023-03-31 16:55:03,556 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 8cf5ab6f2f7a48378b771244291b51f2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:03,556 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting d3691b4bd84c4c6994d32a91c0117304, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:03,557 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 4f6f4a569ad24cf0b1f554f87cdf6cb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:03,557 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 45298dcbb52044089c2cc00d7174ac17, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:03,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4] to archive 2023-03-31 16:55:03,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:03,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5caf3598d770477fa9ac83aa3b6439ca 2023-03-31 16:55:03,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/5636f88893104cf389826f6d8852d5c7 2023-03-31 16:55:03,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/6d2dad366a9a4346b1e9a2504118efc6 2023-03-31 16:55:03,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/4ea0b7bad52e4a9c9492ccbaf8d94bc2 2023-03-31 16:55:03,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/be61d0f23cea4b4f87e047613aa470f4 2023-03-31 16:55:03,600 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 25a5754dee8c6c40ad6587987233065a#family1#compaction#111 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:03,623 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del 2023-03-31 16:55:03,623 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del 2023-03-31 16:55:03,653 WARN [DataStreamer for file /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303311c99313ad00b442e9e0cb7d7a9e35082] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-03-31 16:55:04,076 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc42869e2d794fc19064b18ab8f8f3b7 2023-03-31 16:55:04,077 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/dc42869e2d794fc19064b18ab8f8f3b7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/dc42869e2d794fc19064b18ab8f8f3b7 2023-03-31 16:55:04,081 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc42869e2d794fc19064b18ab8f8f3b7 2023-03-31 16:55:04,082 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25a5754dee8c6c40ad6587987233065a/family1 of 25a5754dee8c6c40ad6587987233065a into dc42869e2d794fc19064b18ab8f8f3b7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:04,083 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:04,083 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:04,083 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 25a5754dee8c6c40ad6587987233065a/family2 is initiating major compaction (all files) 2023-03-31 16:55:04,083 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:04,083 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:04,085 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 25a5754dee8c6c40ad6587987233065a/family2 in testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:04,085 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp, totalSize=25.4 K 2023-03-31 16:55:04,085 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 2a55d5512b194dcb92401775dd4578a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692310 2023-03-31 16:55:04,086 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting c9b46f4d37334e0c8a0d791188ac1135, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:04,086 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 5aba3ec2f5c2419c984aaf749a0dc1bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:04,087 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 0c64467471a64d57bc2a2b24fbc97e2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:04,087 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 2336b33a83074d30aeeb7d1594803712, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-31 16:55:04,116 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 25a5754dee8c6c40ad6587987233065a#family2#compaction#112 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:04,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17] to archive 2023-03-31 16:55:04,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:04,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/342cdd4c99a949d2a4a6c99a75647576 2023-03-31 16:55:04,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/8cf5ab6f2f7a48378b771244291b51f2 2023-03-31 16:55:04,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/d3691b4bd84c4c6994d32a91c0117304 2023-03-31 16:55:04,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/4f6f4a569ad24cf0b1f554f87cdf6cb1 2023-03-31 16:55:04,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/45298dcbb52044089c2cc00d7174ac17 2023-03-31 16:55:04,544 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del 2023-03-31 16:55:04,544 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del 2023-03-31 16:55:04,962 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 772404f1d7c94021906872cca736e441 2023-03-31 16:55:04,963 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/772404f1d7c94021906872cca736e441 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/772404f1d7c94021906872cca736e441 2023-03-31 16:55:04,968 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 772404f1d7c94021906872cca736e441 2023-03-31 16:55:04,970 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 25a5754dee8c6c40ad6587987233065a/family2 of 25a5754dee8c6c40ad6587987233065a into 772404f1d7c94021906872cca736e441(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:04,970 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:04,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712] to archive 2023-03-31 16:55:04,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:04,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2a55d5512b194dcb92401775dd4578a2 2023-03-31 16:55:04,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/c9b46f4d37334e0c8a0d791188ac1135 2023-03-31 16:55:04,981 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:04,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/5aba3ec2f5c2419c984aaf749a0dc1bf 2023-03-31 16:55:04,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/0c64467471a64d57bc2a2b24fbc97e2d 2023-03-31 16:55:04,986 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:04,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/2336b33a83074d30aeeb7d1594803712 2023-03-31 16:55:04,994 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:04,996 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:05,004 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:55:05,068 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-31 16:55:05,072 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del 2023-03-31 16:55:05,078 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del 2023-03-31 16:55:05,082 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del 2023-03-31 16:55:05,082 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:05,083 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(139): Connect 0x07305cf5 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:05,103 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4adbf221, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:05,104 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:05,104 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:05,112 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:06,021 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183 2023-03-31 16:55:06,022 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384 2023-03-31 16:55:06,022 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,036 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,036 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:06,038 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da 2023-03-31 16:55:06,041 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:06,047 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,055 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:55:06,065 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40282, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:55:06,091 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/d0f8088a789545a28d3d4af09cf2e26d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-31 16:55:06,092 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/d0f8088a789545a28d3d4af09cf2e26d}] 2023-03-31 16:55:06,092 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/64e33490cf4a4841a7fd874b0a66ee24 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-31 16:55:06,094 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/64e33490cf4a4841a7fd874b0a66ee24}] 2023-03-31 16:55:06,095 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/742a53a49a854520ba0c61718159cb10 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-31 16:55:06,096 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/742a53a49a854520ba0c61718159cb10}] 2023-03-31 16:55:06,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/d0f8088a789545a28d3d4af09cf2e26d for inclusion in fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:06,103 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/64e33490cf4a4841a7fd874b0a66ee24 for inclusion in 25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:06,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/742a53a49a854520ba0c61718159cb10 for inclusion in 9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last=1 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-31 16:55:06,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-31 16:55:06,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:06,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:06,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/742a53a49a854520ba0c61718159cb10 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__16hp377vua7tckve3mt916k4gqmenrht722q906ogt5bp6o5e19k10rguh4ndc8/family1/742a53a49a854520ba0c61718159cb10 2023-03-31 16:55:06,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/d0f8088a789545a28d3d4af09cf2e26d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__jff0msd9uvvso6c7ssfrapkhq7mq3ekpht6go5j1kcsvkkgob1m7d14ukgq720eg/family1/d0f8088a789545a28d3d4af09cf2e26d 2023-03-31 16:55:06,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/64e33490cf4a4841a7fd874b0a66ee24 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__850hsgd1ujb5vodep2pbpmdch4p2aeji54mmig7tfp5vcottsv9uuhr38mepq541/family1/64e33490cf4a4841a7fd874b0a66ee24 2023-03-31 16:55:06,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__850hsgd1ujb5vodep2pbpmdch4p2aeji54mmig7tfp5vcottsv9uuhr38mepq541/family1/64e33490cf4a4841a7fd874b0a66ee24 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ 2023-03-31 16:55:06,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__jff0msd9uvvso6c7ssfrapkhq7mq3ekpht6go5j1kcsvkkgob1m7d14ukgq720eg/family1/d0f8088a789545a28d3d4af09cf2e26d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ 2023-03-31 16:55:06,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__16hp377vua7tckve3mt916k4gqmenrht722q906ogt5bp6o5e19k10rguh4ndc8/family1/742a53a49a854520ba0c61718159cb10 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ 2023-03-31 16:55:06,111 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__850hsgd1ujb5vodep2pbpmdch4p2aeji54mmig7tfp5vcottsv9uuhr38mepq541/family1/64e33490cf4a4841a7fd874b0a66ee24 into 25a5754dee8c6c40ad6587987233065a/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ - updating store file list. 2023-03-31 16:55:06,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__jff0msd9uvvso6c7ssfrapkhq7mq3ekpht6go5j1kcsvkkgob1m7d14ukgq720eg/family1/d0f8088a789545a28d3d4af09cf2e26d into fd69f5667dfc09dd87ddcab179927c81/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ - updating store file list. 2023-03-31 16:55:06,112 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__16hp377vua7tckve3mt916k4gqmenrht722q906ogt5bp6o5e19k10rguh4ndc8/family1/742a53a49a854520ba0c61718159cb10 into 9e84b76b45cb4571e5ae3c513a680551/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ - updating store file list. 2023-03-31 16:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ into 25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__850hsgd1ujb5vodep2pbpmdch4p2aeji54mmig7tfp5vcottsv9uuhr38mepq541/family1/64e33490cf4a4841a7fd874b0a66ee24 into 25a5754dee8c6c40ad6587987233065a/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_) 2023-03-31 16:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ into 9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:06,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__16hp377vua7tckve3mt916k4gqmenrht722q906ogt5bp6o5e19k10rguh4ndc8/family1/742a53a49a854520ba0c61718159cb10 into 9e84b76b45cb4571e5ae3c513a680551/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_) 2023-03-31 16:55:06,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__850hsgd1ujb5vodep2pbpmdch4p2aeji54mmig7tfp5vcottsv9uuhr38mepq541/family1/64e33490cf4a4841a7fd874b0a66ee24 2023-03-31 16:55:06,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ into fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:06,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__jff0msd9uvvso6c7ssfrapkhq7mq3ekpht6go5j1kcsvkkgob1m7d14ukgq720eg/family1/d0f8088a789545a28d3d4af09cf2e26d into fd69f5667dfc09dd87ddcab179927c81/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_) 2023-03-31 16:55:06,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__16hp377vua7tckve3mt916k4gqmenrht722q906ogt5bp6o5e19k10rguh4ndc8/family1/742a53a49a854520ba0c61718159cb10 2023-03-31 16:55:06,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__jff0msd9uvvso6c7ssfrapkhq7mq3ekpht6go5j1kcsvkkgob1m7d14ukgq720eg/family1/d0f8088a789545a28d3d4af09cf2e26d 2023-03-31 16:55:06,119 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,119 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,119 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,119 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,122 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,122 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,123 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 2023-03-31 16:55:06,123 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee 2023-03-31 16:55:06,123 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa 2023-03-31 16:55:06,125 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df 2023-03-31 16:55:06,125 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad 2023-03-31 16:55:06,125 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 2023-03-31 16:55:06,126 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec 2023-03-31 16:55:06,126 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb 2023-03-31 16:55:06,127 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d 2023-03-31 16:55:06,128 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:06,128 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331' 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331' 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 2023-03-31 16:55:06,128 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:06,128 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331' 2023-03-31 16:55:06,129 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:06,129 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:06,129 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:06,129 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:06,129 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:06,129 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del] 2023-03-31 16:55:06,130 DEBUG [Listener at localhost/38381] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,131 DEBUG [Listener at localhost/38381] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331082c8d96dc63415eb06602f030cfbe2b_del 2023-03-31 16:55:06,131 INFO [Listener at localhost/38381] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-31 16:55:06,131 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del] 2023-03-31 16:55:06,131 DEBUG [Listener at localhost/38381] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,133 DEBUG [Listener at localhost/38381] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331347e493071b140dfbb512a5e66e4b3bd_del 2023-03-31 16:55:06,133 INFO [Listener at localhost/38381] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-31 16:55:06,133 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del] 2023-03-31 16:55:06,133 DEBUG [Listener at localhost/38381] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:06,134 DEBUG [Listener at localhost/38381] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023033132cc16fd422446c3b34db650c40718f3_del 2023-03-31 16:55:06,134 INFO [Listener at localhost/38381] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-31 16:55:06,137 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:06,140 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:06,144 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:06,145 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:06,152 INFO [Listener at localhost/38381] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-31 16:55:06,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-31 16:55:06,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-31 16:55:06,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-31 16:55:06,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281706156"}]},"ts":"1680281706156"} 2023-03-31 16:55:06,157 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-31 16:55:06,159 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-31 16:55:06,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, UNASSIGN}] 2023-03-31 16:55:06,161 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, UNASSIGN 2023-03-31 16:55:06,161 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, UNASSIGN 2023-03-31 16:55:06,162 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, UNASSIGN 2023-03-31 16:55:06,162 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:06,162 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:06,162 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281706162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281706162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281706162"}]},"ts":"1680281706162"} 2023-03-31 16:55:06,162 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281706162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281706162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281706162"}]},"ts":"1680281706162"} 2023-03-31 16:55:06,162 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:06,163 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281706162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281706162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281706162"}]},"ts":"1680281706162"} 2023-03-31 16:55:06,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:06,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:06,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:06,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-31 16:55:06,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:06,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e84b76b45cb4571e5ae3c513a680551, disabling compactions & flushes 2023-03-31 16:55:06,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:06,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:06,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. after waiting 0 ms 2023-03-31 16:55:06,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:06,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-31 16:55:06,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:06,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:06,326 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=CLOSED 2023-03-31 16:55:06,326 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281706326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281706326"}]},"ts":"1680281706326"} 2023-03-31 16:55:06,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:06,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:06,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd69f5667dfc09dd87ddcab179927c81, disabling compactions & flushes 2023-03-31 16:55:06,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:06,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:06,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. after waiting 0 ms 2023-03-31 16:55:06,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:06,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-03-31 16:55:06,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369 in 163 msec 2023-03-31 16:55:06,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, UNASSIGN in 170 msec 2023-03-31 16:55:06,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-31 16:55:06,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:06,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:06,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:06,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25a5754dee8c6c40ad6587987233065a, disabling compactions & flushes 2023-03-31 16:55:06,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. after waiting 0 ms 2023-03-31 16:55:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:06,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=CLOSED 2023-03-31 16:55:06,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281706337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281706337"}]},"ts":"1680281706337"} 2023-03-31 16:55:06,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-31 16:55:06,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369 in 174 msec 2023-03-31 16:55:06,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, UNASSIGN in 181 msec 2023-03-31 16:55:06,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-31 16:55:06,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:06,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:06,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:06,347 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=CLOSED 2023-03-31 16:55:06,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281706347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281706347"}]},"ts":"1680281706347"} 2023-03-31 16:55:06,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-31 16:55:06,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369 in 184 msec 2023-03-31 16:55:06,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-31 16:55:06,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, UNASSIGN in 192 msec 2023-03-31 16:55:06,362 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281706362"}]},"ts":"1680281706362"} 2023-03-31 16:55:06,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-31 16:55:06,366 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-31 16:55:06,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 213 msec 2023-03-31 16:55:06,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-31 16:55:06,458 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-31 16:55:06,714 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:06,714 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7b9944 to 127.0.0.1:57785 2023-03-31 16:55:06,715 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:06,715 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:06,716 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-31 16:55:06,717 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07305cf5 to 127.0.0.1:57785 2023-03-31 16:55:06,717 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:06,725 INFO [Listener at localhost/38381] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:06,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:55:06,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1680281706727 (current time:1680281706727). 2023-03-31 16:55:06,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-31 16:55:06,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] zookeeper.ReadOnlyZKClient(139): Connect 0x0aa72454 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:06,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf507de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:06,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:06,741 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:06,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0aa72454 to 127.0.0.1:57785 2023-03-31 16:55:06,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:06,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-31 16:55:06,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:55:06,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:55:06,750 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:55:06,752 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1680282306752 2023-03-31 16:55:06,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:55:06,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1680281698114-1680281706725 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-31 16:55:06,754 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:06,754 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-31 16:55:06,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-31 16:55:06,763 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-31 16:55:06,763 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-31 16:55:06,764 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-31 16:55:06,781 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/dc42869e2d794fc19064b18ab8f8f3b7] hfiles 2023-03-31 16:55:06,782 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ 2023-03-31 16:55:06,782 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/dc42869e2d794fc19064b18ab8f8f3b7 2023-03-31 16:55:06,783 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/772404f1d7c94021906872cca736e441] hfiles 2023-03-31 16:55:06,783 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/772404f1d7c94021906872cca736e441 2023-03-31 16:55:06,797 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/e0d08134095c40799623fca5d375b647] hfiles 2023-03-31 16:55:06,798 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ 2023-03-31 16:55:06,798 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/e0d08134095c40799623fca5d375b647 2023-03-31 16:55:06,798 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/fd2be47922ec43718f0a435f20d04f5b] hfiles 2023-03-31 16:55:06,798 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ 2023-03-31 16:55:06,798 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/fd2be47922ec43718f0a435f20d04f5b 2023-03-31 16:55:06,799 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384] hfiles 2023-03-31 16:55:06,799 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da 2023-03-31 16:55:06,799 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183 2023-03-31 16:55:06,799 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384 2023-03-31 16:55:06,800 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/9f3b016b3b854eb0b4935a49d8217a83] hfiles 2023-03-31 16:55:06,800 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/9f3b016b3b854eb0b4935a49d8217a83 2023-03-31 16:55:06,801 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/2dbe1f38aae64a1cb73d2b13786003fb] hfiles 2023-03-31 16:55:06,801 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/2dbe1f38aae64a1cb73d2b13786003fb 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675] hfiles 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331281045e7affd471090a2b841b8c31437 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303317b1d555af7304d5691ba3f5464fe5930 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023033187bbed005b8347a083c3e33eb236eb55 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230331adb982ede21e4cac9ae362297d0f2897 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118b8de6b83744efe8af0c079fb194cb3 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023033118df8178fa6249388c807e93241176a0 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303317ce8c8b487b847a5a3c4339c874ad7cd 2023-03-31 16:55:06,808 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331a1c38bfa986c49f5b35b3d47dd85e830 2023-03-31 16:55:06,809 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033106d2fc87ae714374a4d42af1ff50503b 2023-03-31 16:55:06,809 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303311085d762b6ce4c07bd3c3f1f3bb3b638 2023-03-31 16:55:06,809 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033145ed2830b44c44d5ae883a9edc956e0f 2023-03-31 16:55:06,809 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del 2023-03-31 16:55:06,809 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230331cff8705a1d7b4508a3c19fefc8b1e675 2023-03-31 16:55:06,854 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:55:06,855 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-31 16:55:07,056 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:07,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:07,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:55:07,057 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-31 16:55:07,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-31 16:55:07,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:07,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:07,358 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:07,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:07,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:55:07,359 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-31 16:55:07,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680281698114-1680281706725 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:07,859 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:07,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:07,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-31 16:55:07,860 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-31 16:55:08,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1680281698114-1680281706725 of table testCompactionWithHFileLink completed 2023-03-31 16:55:08,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:08,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:08,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1680281698114-1680281706725 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1680281706752Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1680281706761 (+9 ms)Consolidate snapshot: hbase-failsafe-snaptb-1680281698114-1680281706725 at 1680281707205 (+444 ms)Loading Region manifests for hbase-failsafe-snaptb-1680281698114-1680281706725 at 1680281707205Writing data manifest for hbase-failsafe-snaptb-1680281698114-1680281706725 at 1680281707214 (+9 ms)Verifying snapshot: hbase-failsafe-snaptb-1680281698114-1680281706725 at 1680281707639 (+425 ms)Snapshot hbase-failsafe-snaptb-1680281698114-1680281706725 of table testCompactionWithHFileLink completed at 1680281708474 (+835 ms) 2023-03-31 16:55:08,475 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-31 16:55:08,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.7270 sec 2023-03-31 16:55:08,861 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-31 16:55:08,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-31 16:55:08,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1680281698114-1680281706725 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-31 16:55:08,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680281698114" table: "testCompactionWithHFileLink" creation_time: 1680281698127 type: FLUSH version: 2 ttl: 0 ) 2023-03-31 16:55:08,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1680281698114 as table=testCompactionWithHFileLink 2023-03-31 16:55:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-31 16:55:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-31 16:55:09,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-31 16:55:09,312 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-31 16:55:09,313 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-31 16:55:09,313 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-31 16:55:09,314 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-31 16:55:09,318 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1680281698114" table: "testCompactionWithHFileLink" creation_time: 1680281698127 type: FLUSH version: 2 ttl: 0 2023-03-31 16:55:09,318 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink 2023-03-31 16:55:09,323 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-31 16:55:09,326 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303313c02fad1137d40faaf946dc005197384 2023-03-31 16:55:09,327 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331e165e25463034e03bb13d9250e5e51da 2023-03-31 16:55:09,328 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230331e433393ed2a244f18a0b17a2e2845183 2023-03-31 16:55:09,328 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,331 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,334 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,337 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,339 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,342 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,344 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,347 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,350 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,353 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,356 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,358 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d of snapshot=snaptb-1680281698114 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-31 16:55:09,363 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023033162061a8145274ab280f43818f10c20b9_del 2023-03-31 16:55:09,364 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230331566068a4b41647d1ae8e59ce19e7a2db_del 2023-03-31 16:55:09,365 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303316f20ab1832ca4af1a184ace1f3517bb6_del 2023-03-31 16:55:09,365 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,365 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:09,365 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,368 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/21983fe7d42b48be89cb0a01f410c0bc_SeqId_29_ 2023-03-31 16:55:09,369 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/5ee35e90d7c14ad7b6721c0fa350ec00_SeqId_29_ 2023-03-31 16:55:09,369 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/dc42869e2d794fc19064b18ab8f8f3b7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/dc42869e2d794fc19064b18ab8f8f3b7 2023-03-31 16:55:09,370 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/fd2be47922ec43718f0a435f20d04f5b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/fd2be47922ec43718f0a435f20d04f5b 2023-03-31 16:55:09,370 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8fdc977cd8f464cb8631da5d79471c7 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,370 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/9e9ad9e289c24b598d11005f3d8e6cc0_SeqId_29_ 2023-03-31 16:55:09,370 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 342cdd4c99a949d2a4a6c99a75647576 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,371 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/e0d08134095c40799623fca5d375b647 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/e0d08134095c40799623fca5d375b647 2023-03-31 16:55:09,371 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7d016b1ab74143f69cfebc0afe48ed63 of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,376 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c65272a11ec546818124c29933577e70 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,376 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8cf5ab6f2f7a48378b771244291b51f2 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,376 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 089f982ec0764791998b4718fda389b0 of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,379 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d3691b4bd84c4c6994d32a91c0117304 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,379 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b544a161407c42689c0f25823bc34c18 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,379 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2fc68a047a49448d8afc6e10984d961b of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,382 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4f6f4a569ad24cf0b1f554f87cdf6cb1 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,382 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc4a4feee3824797b7d20832b9a19dcc of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,383 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 64cc88fb3e86442c8e05095c9ea5e690 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,389 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/9f3b016b3b854eb0b4935a49d8217a83 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/9f3b016b3b854eb0b4935a49d8217a83 2023-03-31 16:55:09,389 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5caf3598d770477fa9ac83aa3b6439ca of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,389 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/772404f1d7c94021906872cca736e441 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/772404f1d7c94021906872cca736e441 2023-03-31 16:55:09,389 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/2dbe1f38aae64a1cb73d2b13786003fb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/2dbe1f38aae64a1cb73d2b13786003fb 2023-03-31 16:55:09,389 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2a55d5512b194dcb92401775dd4578a2 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,390 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1fe4fd3823524f7ebbbd90380e9de9e0 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,394 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a36d51ab3b664ce9a9de4ff85b9e26ed of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,394 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5636f88893104cf389826f6d8852d5c7 of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,394 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9b46f4d37334e0c8a0d791188ac1135 of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,398 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 432df3e7594c4d5da5bb9da7957b58de of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,398 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6d2dad366a9a4346b1e9a2504118efc6 of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,399 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5aba3ec2f5c2419c984aaf749a0dc1bf of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,401 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7a55308a90fe411f82bc9508c93f8888 of snapshot=snaptb-1680281698114 to region=9e84b76b45cb4571e5ae3c513a680551 table=testCompactionWithHFileLink 2023-03-31 16:55:09,402 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4ea0b7bad52e4a9c9492ccbaf8d94bc2 of snapshot=snaptb-1680281698114 to region=fd69f5667dfc09dd87ddcab179927c81 table=testCompactionWithHFileLink 2023-03-31 16:55:09,402 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0c64467471a64d57bc2a2b24fbc97e2d of snapshot=snaptb-1680281698114 to region=25a5754dee8c6c40ad6587987233065a table=testCompactionWithHFileLink 2023-03-31 16:55:09,405 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1680281698114" table: "testCompactionWithHFileLink" creation_time: 1680281698127 type: FLUSH version: 2 ttl: 0 2023-03-31 16:55:09,406 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680281709406"}]},"ts":"9223372036854775807"} 2023-03-31 16:55:09,406 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680281709406"}]},"ts":"9223372036854775807"} 2023-03-31 16:55:09,406 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1680281709406"}]},"ts":"9223372036854775807"} 2023-03-31 16:55:09,408 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-31 16:55:09,408 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25a5754dee8c6c40ad6587987233065a, NAME => 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 9e84b76b45cb4571e5ae3c513a680551, NAME => 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fd69f5667dfc09dd87ddcab179927c81, NAME => 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.', STARTKEY => '2', ENDKEY => ''}] 2023-03-31 16:55:09,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281709407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281709407"}]},"ts":"1680281709407"} 2023-03-31 16:55:09,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281709407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281709407"}]},"ts":"1680281709407"} 2023-03-31 16:55:09,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281709407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281709407"}]},"ts":"1680281709407"} 2023-03-31 16:55:09,410 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-31 16:55:09,410 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-31 16:55:09,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 25a5754dee8c6c40ad6587987233065a, NAME => 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 9e84b76b45cb4571e5ae3c513a680551, NAME => 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fd69f5667dfc09dd87ddcab179927c81, NAME => 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.', STARTKEY => '2', ENDKEY => ''}] 2023-03-31 16:55:09,411 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1680281698114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-31 16:55:09,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1680281698114" table: "testCompactionWithHFileLink" creation_time: 1680281698127 type: FLUSH version: 2 ttl: 0 ) in 518 msec 2023-03-31 16:55:09,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-31 16:55:09,508 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-31 16:55:09,508 INFO [Listener at localhost/38381] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:09,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1680281698114-1680281706725" 2023-03-31 16:55:09,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1680281698114-1680281706725 2023-03-31 16:55:09,517 INFO [Listener at localhost/38381] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-31 16:55:09,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-31 16:55:09,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-31 16:55:09,529 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-31 16:55:09,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281709529"}]},"ts":"1680281709529"} 2023-03-31 16:55:09,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-31 16:55:09,530 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-31 16:55:09,532 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-31 16:55:09,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN}] 2023-03-31 16:55:09,534 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN 2023-03-31 16:55:09,534 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN 2023-03-31 16:55:09,534 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN 2023-03-31 16:55:09,534 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-31 16:55:09,534 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-31 16:55:09,534 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-31 16:55:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-31 16:55:09,686 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:09,686 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:09,686 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:09,686 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281709686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281709686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281709686"}]},"ts":"1680281709686"} 2023-03-31 16:55:09,686 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281709686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281709686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281709686"}]},"ts":"1680281709686"} 2023-03-31 16:55:09,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281709686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281709686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281709686"}]},"ts":"1680281709686"} 2023-03-31 16:55:09,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:09,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:09,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:09,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-31 16:55:09,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25a5754dee8c6c40ad6587987233065a, NAME => 'testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.', STARTKEY => '1', ENDKEY => '2'} 2023-03-31 16:55:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,843 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,844 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:09,844 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:09,844 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a5754dee8c6c40ad6587987233065a columnFamilyName family1 2023-03-31 16:55:09,860 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576 2023-03-31 16:55:09,865 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1 2023-03-31 16:55:09,869 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2 2023-03-31 16:55:09,874 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304 2023-03-31 16:55:09,874 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(310): Store=25a5754dee8c6c40ad6587987233065a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:09,874 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,875 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2 2023-03-31 16:55:09,875 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2 2023-03-31 16:55:09,876 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a5754dee8c6c40ad6587987233065a columnFamilyName family2 2023-03-31 16:55:09,883 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d 2023-03-31 16:55:09,888 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2 2023-03-31 16:55:09,893 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf 2023-03-31 16:55:09,898 DEBUG [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135 2023-03-31 16:55:09,898 INFO [StoreOpener-25a5754dee8c6c40ad6587987233065a-1] regionserver.HStore(310): Store=25a5754dee8c6c40ad6587987233065a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:09,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:09,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:09,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25a5754dee8c6c40ad6587987233065a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66569886, jitterRate=-0.008031398057937622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:09,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:09,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., pid=103, masterSystemTime=1680281709839 2023-03-31 16:55:09,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:09,904 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-31 16:55:09,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-31 16:55:09,904 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:09,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:09,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd69f5667dfc09dd87ddcab179927c81, NAME => 'testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.', STARTKEY => '2', ENDKEY => ''} 2023-03-31 16:55:09,906 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=25a5754dee8c6c40ad6587987233065a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:09,906 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281709906"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281709906"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281709906"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281709906"}]},"ts":"1680281709906"} 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,907 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-31 16:55:09,907 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1912): 25a5754dee8c6c40ad6587987233065a/family2 is initiating minor compaction (all files) 2023-03-31 16:55:09,907 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 25a5754dee8c6c40ad6587987233065a/family2 in testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:09,908 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp, totalSize=20.4 K 2023-03-31 16:55:09,908 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-31 16:55:09,908 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,908 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1912): 25a5754dee8c6c40ad6587987233065a/family1 is initiating minor compaction (all files) 2023-03-31 16:55:09,908 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 25a5754dee8c6c40ad6587987233065a/family1 in testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:09,908 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp, totalSize=21.6 K 2023-03-31 16:55:09,909 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692310 2023-03-31 16:55:09,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-31 16:55:09,909 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692310 2023-03-31 16:55:09,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 25a5754dee8c6c40ad6587987233065a, server=jenkins-hbase4.apache.org,41157,1680281619369 in 219 msec 2023-03-31 16:55:09,909 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:09,910 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:09,910 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:09,910 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd69f5667dfc09dd87ddcab179927c81 columnFamilyName family1 2023-03-31 16:55:09,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=25a5754dee8c6c40ad6587987233065a, ASSIGN in 377 msec 2023-03-31 16:55:09,911 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:09,911 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:09,911 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:09,912 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:09,913 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:09,925 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0 2023-03-31 16:55:09,934 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b 2023-03-31 16:55:09,948 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63 2023-03-31 16:55:09,950 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 25a5754dee8c6c40ad6587987233065a#family1#compaction#113 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:09,958 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] throttle.PressureAwareThroughputController(145): 25a5754dee8c6c40ad6587987233065a#family2#compaction#114 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:09,962 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc 2023-03-31 16:55:09,963 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(310): Store=fd69f5667dfc09dd87ddcab179927c81/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:09,963 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,964 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2 2023-03-31 16:55:09,964 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2 2023-03-31 16:55:09,964 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd69f5667dfc09dd87ddcab179927c81 columnFamilyName family2 2023-03-31 16:55:09,972 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2 2023-03-31 16:55:09,976 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7 2023-03-31 16:55:09,979 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca 2023-03-31 16:55:09,983 DEBUG [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6 2023-03-31 16:55:09,983 INFO [StoreOpener-fd69f5667dfc09dd87ddcab179927c81-1] regionserver.HStore(310): Store=fd69f5667dfc09dd87ddcab179927c81/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:09,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:09,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:09,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd69f5667dfc09dd87ddcab179927c81; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69572121, jitterRate=0.036705389618873596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:09,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:09,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., pid=102, masterSystemTime=1680281709839 2023-03-31 16:55:09,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-31 16:55:09,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-31 16:55:09,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:09,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:09,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:09,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e84b76b45cb4571e5ae3c513a680551, NAME => 'testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.', STARTKEY => '', ENDKEY => '1'} 2023-03-31 16:55:09,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:09,990 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fd69f5667dfc09dd87ddcab179927c81, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:09,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:09,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:09,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:09,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281709990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281709990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281709990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281709990"}]},"ts":"1680281709990"} 2023-03-31 16:55:09,992 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:09,993 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:09,993 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:09,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-03-31 16:55:09,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure fd69f5667dfc09dd87ddcab179927c81, server=jenkins-hbase4.apache.org,41157,1680281619369 in 303 msec 2023-03-31 16:55:09,993 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e84b76b45cb4571e5ae3c513a680551 columnFamilyName family1 2023-03-31 16:55:09,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd69f5667dfc09dd87ddcab179927c81, ASSIGN in 461 msec 2023-03-31 16:55:09,999 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690 2023-03-31 16:55:10,004 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7 2023-03-31 16:55:10,008 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18 2023-03-31 16:55:10,014 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70 2023-03-31 16:55:10,014 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(310): Store=9e84b76b45cb4571e5ae3c513a680551/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:10,015 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:10,015 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2 2023-03-31 16:55:10,015 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2 2023-03-31 16:55:10,016 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e84b76b45cb4571e5ae3c513a680551 columnFamilyName family2 2023-03-31 16:55:10,024 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0 2023-03-31 16:55:10,029 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de 2023-03-31 16:55:10,038 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888 2023-03-31 16:55:10,045 DEBUG [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(539): loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed 2023-03-31 16:55:10,045 INFO [StoreOpener-9e84b76b45cb4571e5ae3c513a680551-1] regionserver.HStore(310): Store=9e84b76b45cb4571e5ae3c513a680551/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:10,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:10,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:10,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:10,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:10,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e84b76b45cb4571e5ae3c513a680551; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74364008, jitterRate=0.10811007022857666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:10,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:10,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., pid=101, masterSystemTime=1680281709839 2023-03-31 16:55:10,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-31 16:55:10,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-31 16:55:10,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:10,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:10,058 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9e84b76b45cb4571e5ae3c513a680551, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:10,058 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1680281710057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281710057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281710057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281710057"}]},"ts":"1680281710057"} 2023-03-31 16:55:10,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-03-31 16:55:10,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 9e84b76b45cb4571e5ae3c513a680551, server=jenkins-hbase4.apache.org,41157,1680281619369 in 372 msec 2023-03-31 16:55:10,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-03-31 16:55:10,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9e84b76b45cb4571e5ae3c513a680551, ASSIGN in 529 msec 2023-03-31 16:55:10,063 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281710063"}]},"ts":"1680281710063"} 2023-03-31 16:55:10,064 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-31 16:55:10,067 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-31 16:55:10,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 546 msec 2023-03-31 16:55:10,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-31 16:55:10,132 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-31 16:55:10,144 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:10,153 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:10,161 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:10,162 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:10,169 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:55:10,183 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-31 16:55:10,183 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:10,183 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(139): Connect 0x5753ab19 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:10,188 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54f6fa62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:10,188 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:10,188 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:10,188 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:10,658 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331513a3e4cf39d4affbc132bc6d36eaa5e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230331513a3e4cf39d4affbc132bc6d36eaa5e 2023-03-31 16:55:10,659 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:10,672 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:10,675 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:10,682 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:55:10,684 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:55:10,694 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/5c89c3b6590147229c972e96365c7bcc first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-31 16:55:10,694 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/5c89c3b6590147229c972e96365c7bcc}] 2023-03-31 16:55:10,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/5c89c3b6590147229c972e96365c7bcc for inclusion in 9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-31 16:55:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last=1 2023-03-31 16:55:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:10,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331/family1/5c89c3b6590147229c972e96365c7bcc to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__fqn1uktmd2aqlku48k2pitun073vr90v3p19v8obph1r5653rpf537ag30ie7s1/family1/5c89c3b6590147229c972e96365c7bcc 2023-03-31 16:55:10,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__fqn1uktmd2aqlku48k2pitun073vr90v3p19v8obph1r5653rpf537ag30ie7s1/family1/5c89c3b6590147229c972e96365c7bcc as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_ 2023-03-31 16:55:10,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__fqn1uktmd2aqlku48k2pitun073vr90v3p19v8obph1r5653rpf537ag30ie7s1/family1/5c89c3b6590147229c972e96365c7bcc into 9e84b76b45cb4571e5ae3c513a680551/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_ - updating store file list. 2023-03-31 16:55:10,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_ into 9e84b76b45cb4571e5ae3c513a680551/family1 2023-03-31 16:55:10,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__fqn1uktmd2aqlku48k2pitun073vr90v3p19v8obph1r5653rpf537ag30ie7s1/family1/5c89c3b6590147229c972e96365c7bcc into 9e84b76b45cb4571e5ae3c513a680551/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_) 2023-03-31 16:55:10,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__fqn1uktmd2aqlku48k2pitun073vr90v3p19v8obph1r5653rpf537ag30ie7s1/family1/5c89c3b6590147229c972e96365c7bcc 2023-03-31 16:55:10,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:10,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-31 16:55:10,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(1912): 9e84b76b45cb4571e5ae3c513a680551/family1 is initiating minor compaction (all files) 2023-03-31 16:55:10,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b64e7f6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-31 16:55:10,712 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:10,712 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:10,714 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331795aabdc74614853bd79fc584fa514ee 2023-03-31 16:55:10,715 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303319fe163bbfea247e2b3b16f6b3c9746ad 2023-03-31 16:55:10,715 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331cbafcaf787a34a2e8494917c1baf8aec 2023-03-31 16:55:10,716 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230331dbad723da00f4de0bf5c9642e09ded2d 2023-03-31 16:55:10,716 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:10,716 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230331' 2023-03-31 16:55:10,717 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:10,778 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family2/573e0c5babf4413aa6a7a426e7c68c89 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/573e0c5babf4413aa6a7a426e7c68c89 2023-03-31 16:55:10,781 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 25a5754dee8c6c40ad6587987233065a/family2 of 25a5754dee8c6c40ad6587987233065a into 573e0c5babf4413aa6a7a426e7c68c89(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:10,781 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:10,782 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., storeName=25a5754dee8c6c40ad6587987233065a/family2, priority=12, startTime=1680281709904; duration=0sec 2023-03-31 16:55:10,782 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-31 16:55:10,782 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9e84b76b45cb4571e5ae3c513a680551/family1 in testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:10,782 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp, totalSize=28.9 K 2023-03-31 16:55:10,782 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692309 2023-03-31 16:55:10,783 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:10,783 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:10,784 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696686 2023-03-31 16:55:10,784 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting 19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1680281692309 2023-03-31 16:55:10,796 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] throttle.PressureAwareThroughputController(145): 9e84b76b45cb4571e5ae3c513a680551#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:10,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d] to archive 2023-03-31 16:55:10,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:10,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-2a55d5512b194dcb92401775dd4578a2 2023-03-31 16:55:10,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-c9b46f4d37334e0c8a0d791188ac1135 2023-03-31 16:55:10,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-5aba3ec2f5c2419c984aaf749a0dc1bf 2023-03-31 16:55:10,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family2/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-0c64467471a64d57bc2a2b24fbc97e2d 2023-03-31 16:55:11,057 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331c81b2971e2294f388e6e8918f64da043 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230331c81b2971e2294f388e6e8918f64da043 2023-03-31 16:55:11,057 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303310458b6bfbf9848ae83805c78a0657e69 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303310458b6bfbf9848ae83805c78a0657e69 2023-03-31 16:55:11,058 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:11,058 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:11,086 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/176fd8da06874f4c965e9a1adda2dbf6 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-31 16:55:11,087 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/176fd8da06874f4c965e9a1adda2dbf6}] 2023-03-31 16:55:11,088 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/95928fc65ac84987a16a59cfc4d4e699 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-31 16:55:11,088 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/95928fc65ac84987a16a59cfc4d4e699}] 2023-03-31 16:55:11,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/176fd8da06874f4c965e9a1adda2dbf6 for inclusion in 25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:11,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/95928fc65ac84987a16a59cfc4d4e699 for inclusion in fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:11,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-31 16:55:11,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-31 16:55:11,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:11,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-31 16:55:11,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-31 16:55:11,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:11,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331/family1/176fd8da06874f4c965e9a1adda2dbf6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__3btbjivbng0k63f5k5j5h6b3keeh9152e3fv60jpk6rbv2ck11kd79qm0gcttm8q/family1/176fd8da06874f4c965e9a1adda2dbf6 2023-03-31 16:55:11,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331/family1/95928fc65ac84987a16a59cfc4d4e699 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__uc8iu7all1ar3dgus988l6npl23hbkl1g437mp3u1kmktsi3gn1jeq1jiffvkcl0/family1/95928fc65ac84987a16a59cfc4d4e699 2023-03-31 16:55:11,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__3btbjivbng0k63f5k5j5h6b3keeh9152e3fv60jpk6rbv2ck11kd79qm0gcttm8q/family1/176fd8da06874f4c965e9a1adda2dbf6 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/7465418cdf4a447f95cc36d33ad2e618_SeqId_35_ 2023-03-31 16:55:11,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__uc8iu7all1ar3dgus988l6npl23hbkl1g437mp3u1kmktsi3gn1jeq1jiffvkcl0/family1/95928fc65ac84987a16a59cfc4d4e699 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_ 2023-03-31 16:55:11,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__3btbjivbng0k63f5k5j5h6b3keeh9152e3fv60jpk6rbv2ck11kd79qm0gcttm8q/family1/176fd8da06874f4c965e9a1adda2dbf6 into 25a5754dee8c6c40ad6587987233065a/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/7465418cdf4a447f95cc36d33ad2e618_SeqId_35_ - updating store file list. 2023-03-31 16:55:11,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__uc8iu7all1ar3dgus988l6npl23hbkl1g437mp3u1kmktsi3gn1jeq1jiffvkcl0/family1/95928fc65ac84987a16a59cfc4d4e699 into fd69f5667dfc09dd87ddcab179927c81/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_ - updating store file list. 2023-03-31 16:55:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_ into fd69f5667dfc09dd87ddcab179927c81/family1 2023-03-31 16:55:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/7465418cdf4a447f95cc36d33ad2e618_SeqId_35_ into 25a5754dee8c6c40ad6587987233065a/family1 2023-03-31 16:55:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__uc8iu7all1ar3dgus988l6npl23hbkl1g437mp3u1kmktsi3gn1jeq1jiffvkcl0/family1/95928fc65ac84987a16a59cfc4d4e699 into fd69f5667dfc09dd87ddcab179927c81/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_) 2023-03-31 16:55:11,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__3btbjivbng0k63f5k5j5h6b3keeh9152e3fv60jpk6rbv2ck11kd79qm0gcttm8q/family1/176fd8da06874f4c965e9a1adda2dbf6 into 25a5754dee8c6c40ad6587987233065a/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/7465418cdf4a447f95cc36d33ad2e618_SeqId_35_) 2023-03-31 16:55:11,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__uc8iu7all1ar3dgus988l6npl23hbkl1g437mp3u1kmktsi3gn1jeq1jiffvkcl0/family1/95928fc65ac84987a16a59cfc4d4e699 2023-03-31 16:55:11,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testCompactionWithHFileLink__3btbjivbng0k63f5k5j5h6b3keeh9152e3fv60jpk6rbv2ck11kd79qm0gcttm8q/family1/176fd8da06874f4c965e9a1adda2dbf6 2023-03-31 16:55:11,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:11,101 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:11,102 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:11,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-31 16:55:11,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(1912): fd69f5667dfc09dd87ddcab179927c81/family1 is initiating minor compaction (all files) 2023-03-31 16:55:11,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3011be70; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-31 16:55:11,104 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033113acff5a75134f14bf9ec276eb77b6f2 2023-03-31 16:55:11,104 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:11,105 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303312241cc51b54941729f32471ad1b379df 2023-03-31 16:55:11,106 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:11,106 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023033134ba67a8245e439991efbef037e8e6eb 2023-03-31 16:55:11,107 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303310fefe0315e5d4d0d9d1dce16f59894aa 2023-03-31 16:55:11,107 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230331e9c57464f3a34e34928c03ba0826de1d 2023-03-31 16:55:11,108 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:11,108 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230331' 2023-03-31 16:55:11,108 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:11,108 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331a1f4913be05f49fdbcbe85386958e913 2023-03-31 16:55:11,109 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331bbb1cb5d8fdb4f09898e968e0dcb2166 2023-03-31 16:55:11,110 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230331d6e6d882e7314db6b6cb52a68ba081b1 2023-03-31 16:55:11,110 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-31 16:55:11,110 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230331' 2023-03-31 16:55:11,111 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230331 for table='testCompactionWithHFileLink' and column='family1' 2023-03-31 16:55:11,111 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-31 16:55:11,114 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:11,118 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:11,121 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:11,122 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:11,129 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:11,130 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:11,148 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 240) - Thread LEAK? -, OpenFileDescriptor=751 (was 600) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=415 (was 386) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3537 (was 3689) 2023-03-31 16:55:11,162 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=751, MaxFileDescriptor=60000, SystemLoadAverage=415, ProcessCount=169, AvailableMemoryMB=3537 2023-03-31 16:55:11,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-31 16:55:11,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-31 16:55:11,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-31 16:55:11,175 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-31 16:55:11,175 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/.tmp/family1/de789a56e2454c9fa00e6dd163fba5be as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/de789a56e2454c9fa00e6dd163fba5be 2023-03-31 16:55:11,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-31 16:55:11,180 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 25a5754dee8c6c40ad6587987233065a/family1 of 25a5754dee8c6c40ad6587987233065a into de789a56e2454c9fa00e6dd163fba5be(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:11,180 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:11,180 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a., storeName=25a5754dee8c6c40ad6587987233065a/family1, priority=12, startTime=1680281709904; duration=1sec 2023-03-31 16:55:11,180 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-31 16:55:11,180 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fd69f5667dfc09dd87ddcab179927c81/family1 in testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:11,180 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp, totalSize=28.9 K 2023-03-31 16:55:11,181 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692311 2023-03-31 16:55:11,181 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:11,182 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:11,182 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:11,183 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting ea424868c7f4440aad8c512529796552_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1680281692311 2023-03-31 16:55:11,196 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): fd69f5667dfc09dd87ddcab179927c81#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:11,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1] to archive 2023-03-31 16:55:11,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:11,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-342cdd4c99a949d2a4a6c99a75647576 2023-03-31 16:55:11,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-8cf5ab6f2f7a48378b771244291b51f2 2023-03-31 16:55:11,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-d3691b4bd84c4c6994d32a91c0117304 2023-03-31 16:55:11,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/family1/testCompactionWithHFileLink=25a5754dee8c6c40ad6587987233065a-4f6f4a569ad24cf0b1f554f87cdf6cb1 2023-03-31 16:55:11,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-31 16:55:11,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-31 16:55:11,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-31 16:55:11,278 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:55:11,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-31 16:55:11,279 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:55:11,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91 empty. 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b empty. 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663 empty. 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:11,281 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:11,282 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:11,282 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-31 16:55:11,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:11,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:11,688 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-31 16:55:11,689 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 681fb89e6933230e50dee80bd3f2107b, NAME => 'ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:11,690 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => b4efe581f49b013f979767b3126b9e91, NAME => 'ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:11,690 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 12d9b8319d30882fd5cfc267a7bc5663, NAME => 'ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:11,823 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:55:11,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:12,018 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family1/3557f0ee37e041cdadfc49119d15f0a4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/3557f0ee37e041cdadfc49119d15f0a4 2023-03-31 16:55:12,021 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 9e84b76b45cb4571e5ae3c513a680551/family1 of 9e84b76b45cb4571e5ae3c513a680551 into 3557f0ee37e041cdadfc49119d15f0a4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:12,021 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:12,021 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1680281710710; duration=1sec 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. because compaction request was cancelled 2023-03-31 16:55:12,022 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-31 16:55:12,023 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-31 16:55:12,023 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1912): 9e84b76b45cb4571e5ae3c513a680551/family2 is initiating minor compaction (all files) 2023-03-31 16:55:12,023 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9e84b76b45cb4571e5ae3c513a680551/family2 in testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:12,023 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp, totalSize=20.4 K 2023-03-31 16:55:12,024 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692309 2023-03-31 16:55:12,024 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:12,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_] to archive 2023-03-31 16:55:12,025 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:12,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:12,026 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696686 2023-03-31 16:55:12,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a8fdc977cd8f464cb8631da5d79471c7 2023-03-31 16:55:12,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-c65272a11ec546818124c29933577e70 2023-03-31 16:55:12,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-b544a161407c42689c0f25823bc34c18 2023-03-31 16:55:12,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-64cc88fb3e86442c8e05095c9ea5e690 2023-03-31 16:55:12,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family1/19e71dddee9e4f1ab123d93dd981f40b_SeqId_34_ 2023-03-31 16:55:12,037 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] throttle.PressureAwareThroughputController(145): 9e84b76b45cb4571e5ae3c513a680551#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing b4efe581f49b013f979767b3126b9e91, disabling compactions & flushes 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,099 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 681fb89e6933230e50dee80bd3f2107b, disabling compactions & flushes 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. after waiting 0 ms 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 12d9b8319d30882fd5cfc267a7bc5663, disabling compactions & flushes 2023-03-31 16:55:12,099 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,099 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. after waiting 0 ms 2023-03-31 16:55:12,099 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,099 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,100 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,100 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. after waiting 0 ms 2023-03-31 16:55:12,100 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,100 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,100 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:12,100 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,100 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:12,102 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:55:12,102 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281712102"}]},"ts":"1680281712102"} 2023-03-31 16:55:12,103 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281712102"}]},"ts":"1680281712102"} 2023-03-31 16:55:12,103 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680281712102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281712102"}]},"ts":"1680281712102"} 2023-03-31 16:55:12,104 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-31 16:55:12,105 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:55:12,105 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281712105"}]},"ts":"1680281712105"} 2023-03-31 16:55:12,106 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-31 16:55:12,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b4efe581f49b013f979767b3126b9e91, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=12d9b8319d30882fd5cfc267a7bc5663, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=681fb89e6933230e50dee80bd3f2107b, ASSIGN}] 2023-03-31 16:55:12,111 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b4efe581f49b013f979767b3126b9e91, ASSIGN 2023-03-31 16:55:12,111 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=12d9b8319d30882fd5cfc267a7bc5663, ASSIGN 2023-03-31 16:55:12,111 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=681fb89e6933230e50dee80bd3f2107b, ASSIGN 2023-03-31 16:55:12,112 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b4efe581f49b013f979767b3126b9e91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:12,112 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=12d9b8319d30882fd5cfc267a7bc5663, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:12,112 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=681fb89e6933230e50dee80bd3f2107b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:12,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b4efe581f49b013f979767b3126b9e91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,264 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=681fb89e6933230e50dee80bd3f2107b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=12d9b8319d30882fd5cfc267a7bc5663, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,265 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281712264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281712264"}]},"ts":"1680281712264"} 2023-03-31 16:55:12,265 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281712264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281712264"}]},"ts":"1680281712264"} 2023-03-31 16:55:12,265 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680281712264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281712264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281712264"}]},"ts":"1680281712264"} 2023-03-31 16:55:12,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 681fb89e6933230e50dee80bd3f2107b, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:12,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure b4efe581f49b013f979767b3126b9e91, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:12,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 12d9b8319d30882fd5cfc267a7bc5663, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:12,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:12,418 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family1/c22a84210e834e699ffa590c7626ee87 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/c22a84210e834e699ffa590c7626ee87 2023-03-31 16:55:12,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12d9b8319d30882fd5cfc267a7bc5663, NAME => 'ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.', STARTKEY => '1', ENDKEY => '2'} 2023-03-31 16:55:12,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,421 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,422 DEBUG [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1 2023-03-31 16:55:12,422 DEBUG [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1 2023-03-31 16:55:12,423 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12d9b8319d30882fd5cfc267a7bc5663 columnFamilyName family1 2023-03-31 16:55:12,423 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in fd69f5667dfc09dd87ddcab179927c81/family1 of fd69f5667dfc09dd87ddcab179927c81 into c22a84210e834e699ffa590c7626ee87(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:12,423 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:12,423 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1680281711103; duration=1sec 2023-03-31 16:55:12,423 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-31 16:55:12,423 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-31 16:55:12,424 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] regionserver.HStore(310): Store=12d9b8319d30882fd5cfc267a7bc5663/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,424 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,425 DEBUG [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2 2023-03-31 16:55:12,425 DEBUG [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2 2023-03-31 16:55:12,425 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-31 16:55:12,425 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1912): fd69f5667dfc09dd87ddcab179927c81/family2 is initiating minor compaction (all files) 2023-03-31 16:55:12,425 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fd69f5667dfc09dd87ddcab179927c81/family2 in testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:12,425 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12d9b8319d30882fd5cfc267a7bc5663 columnFamilyName family2 2023-03-31 16:55:12,425 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp, totalSize=20.4 K 2023-03-31 16:55:12,426 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281692311 2023-03-31 16:55:12,427 INFO [StoreOpener-12d9b8319d30882fd5cfc267a7bc5663-1] regionserver.HStore(310): Store=12d9b8319d30882fd5cfc267a7bc5663/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,427 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281693802 2023-03-31 16:55:12,428 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281695622 2023-03-31 16:55:12,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,428 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281696687 2023-03-31 16:55:12,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:12,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:12,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:12,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 12d9b8319d30882fd5cfc267a7bc5663; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69447464, jitterRate=0.03484785556793213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:12,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:12,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663., pid=111, masterSystemTime=1680281712417 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:12,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4efe581f49b013f979767b3126b9e91, NAME => 'ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.', STARTKEY => '', ENDKEY => '1'} 2023-03-31 16:55:12,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=12d9b8319d30882fd5cfc267a7bc5663, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1680281712436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281712436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281712436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281712436"}]},"ts":"1680281712436"} 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,438 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-03-31 16:55:12,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 12d9b8319d30882fd5cfc267a7bc5663, server=jenkins-hbase4.apache.org,41157,1680281619369 in 171 msec 2023-03-31 16:55:12,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=12d9b8319d30882fd5cfc267a7bc5663, ASSIGN in 329 msec 2023-03-31 16:55:12,448 DEBUG [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1 2023-03-31 16:55:12,448 DEBUG [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1 2023-03-31 16:55:12,449 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4efe581f49b013f979767b3126b9e91 columnFamilyName family1 2023-03-31 16:55:12,450 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] regionserver.HStore(310): Store=b4efe581f49b013f979767b3126b9e91/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,451 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,452 DEBUG [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2 2023-03-31 16:55:12,452 DEBUG [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2 2023-03-31 16:55:12,452 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4efe581f49b013f979767b3126b9e91 columnFamilyName family2 2023-03-31 16:55:12,453 INFO [StoreOpener-b4efe581f49b013f979767b3126b9e91-1] regionserver.HStore(310): Store=b4efe581f49b013f979767b3126b9e91/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,456 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): fd69f5667dfc09dd87ddcab179927c81#family2#compaction#118 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:12,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:12,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:12,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:12,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b4efe581f49b013f979767b3126b9e91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70254596, jitterRate=0.046875059604644775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:12,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:12,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91., pid=110, masterSystemTime=1680281712417 2023-03-31 16:55:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:12,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 681fb89e6933230e50dee80bd3f2107b, NAME => 'ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.', STARTKEY => '2', ENDKEY => ''} 2023-03-31 16:55:12,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=b4efe581f49b013f979767b3126b9e91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:12,471 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281712470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281712470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281712470"}]},"ts":"1680281712470"} 2023-03-31 16:55:12,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,472 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,473 DEBUG [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1 2023-03-31 16:55:12,473 DEBUG [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1 2023-03-31 16:55:12,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-03-31 16:55:12,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure b4efe581f49b013f979767b3126b9e91, server=jenkins-hbase4.apache.org,41157,1680281619369 in 206 msec 2023-03-31 16:55:12,473 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 681fb89e6933230e50dee80bd3f2107b columnFamilyName family1 2023-03-31 16:55:12,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b4efe581f49b013f979767b3126b9e91, ASSIGN in 363 msec 2023-03-31 16:55:12,474 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] regionserver.HStore(310): Store=681fb89e6933230e50dee80bd3f2107b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,475 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,476 DEBUG [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2 2023-03-31 16:55:12,476 DEBUG [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2 2023-03-31 16:55:12,476 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 681fb89e6933230e50dee80bd3f2107b columnFamilyName family2 2023-03-31 16:55:12,477 INFO [StoreOpener-681fb89e6933230e50dee80bd3f2107b-1] regionserver.HStore(310): Store=681fb89e6933230e50dee80bd3f2107b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:12,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:12,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:12,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:12,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 681fb89e6933230e50dee80bd3f2107b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72668477, jitterRate=0.08284468948841095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:12,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:12,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b., pid=109, masterSystemTime=1680281712417 2023-03-31 16:55:12,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:12,483 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=681fb89e6933230e50dee80bd3f2107b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:12,483 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1680281712483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281712483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281712483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281712483"}]},"ts":"1680281712483"} 2023-03-31 16:55:12,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-03-31 16:55:12,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 681fb89e6933230e50dee80bd3f2107b, server=jenkins-hbase4.apache.org,41157,1680281619369 in 219 msec 2023-03-31 16:55:12,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-31 16:55:12,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=681fb89e6933230e50dee80bd3f2107b, ASSIGN in 376 msec 2023-03-31 16:55:12,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:55:12,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281712487"}]},"ts":"1680281712487"} 2023-03-31 16:55:12,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-31 16:55:12,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:55:12,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2140 sec 2023-03-31 16:55:12,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_] to archive 2023-03-31 16:55:12,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:12,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-7d016b1ab74143f69cfebc0afe48ed63 2023-03-31 16:55:12,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-089f982ec0764791998b4718fda389b0 2023-03-31 16:55:12,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-2fc68a047a49448d8afc6e10984d961b 2023-03-31 16:55:12,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-bc4a4feee3824797b7d20832b9a19dcc 2023-03-31 16:55:12,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family1/ea424868c7f4440aad8c512529796552_SeqId_34_ 2023-03-31 16:55:13,263 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/.tmp/family2/f0692342c2784cc7983d64b0641b6a01 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/f0692342c2784cc7983d64b0641b6a01 2023-03-31 16:55:13,267 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9e84b76b45cb4571e5ae3c513a680551/family2 of 9e84b76b45cb4571e5ae3c513a680551 into f0692342c2784cc7983d64b0641b6a01(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:13,267 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:13,267 INFO [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551., storeName=9e84b76b45cb4571e5ae3c513a680551/family2, priority=12, startTime=1680281710055; duration=1sec 2023-03-31 16:55:13,267 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-31 16:55:13,267 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-31 16:55:13,267 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-31 16:55:13,268 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-31 16:55:13,268 DEBUG [RS:0;jenkins-hbase4:41157-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. because compaction request was cancelled 2023-03-31 16:55:13,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888] to archive 2023-03-31 16:55:13,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:13,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-1fe4fd3823524f7ebbbd90380e9de9e0 2023-03-31 16:55:13,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-a36d51ab3b664ce9a9de4ff85b9e26ed 2023-03-31 16:55:13,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-432df3e7594c4d5da5bb9da7957b58de 2023-03-31 16:55:13,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/family2/testCompactionWithHFileLink=9e84b76b45cb4571e5ae3c513a680551-7a55308a90fe411f82bc9508c93f8888 2023-03-31 16:55:13,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-31 16:55:13,384 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-31 16:55:13,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:13,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:13,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:13,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:13,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-31 16:55:13,393 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-31 16:55:13,393 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:13,393 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-31 16:55:13,393 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-31 16:55:13,394 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:13,394 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:13,395 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:13,395 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:13,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:13,395 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:13,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:13,395 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:13,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:13,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:13,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-31 16:55:13,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-31 16:55:13,396 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-31 16:55:13,396 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:13,396 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-31 16:55:13,397 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:13,397 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. started... 2023-03-31 16:55:13,397 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:13,397 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:13,398 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:13,398 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12d9b8319d30882fd5cfc267a7bc5663 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:13,398 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. started... 2023-03-31 16:55:13,397 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:13,399 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. started... 2023-03-31 16:55:13,399 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 681fb89e6933230e50dee80bd3f2107b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:13,399 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b4efe581f49b013f979767b3126b9e91 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:13,676 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/.tmp/family2/327e7c0a62914d9196c5aa97fc2472a0 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/327e7c0a62914d9196c5aa97fc2472a0 2023-03-31 16:55:13,680 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fd69f5667dfc09dd87ddcab179927c81/family2 of fd69f5667dfc09dd87ddcab179927c81 into 327e7c0a62914d9196c5aa97fc2472a0(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:13,680 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:13,680 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81., storeName=fd69f5667dfc09dd87ddcab179927c81/family2, priority=12, startTime=1680281709988; duration=1sec 2023-03-31 16:55:13,680 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:13,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2] to archive 2023-03-31 16:55:13,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:13,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5caf3598d770477fa9ac83aa3b6439ca 2023-03-31 16:55:13,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-5636f88893104cf389826f6d8852d5c7 2023-03-31 16:55:13,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-6d2dad366a9a4346b1e9a2504118efc6 2023-03-31 16:55:13,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/family2/testCompactionWithHFileLink=fd69f5667dfc09dd87ddcab179927c81-4ea0b7bad52e4a9c9492ccbaf8d94bc2 2023-03-31 16:55:13,810 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303317eabadfc96874efe9ad701a29a158675 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303317eabadfc96874efe9ad701a29a158675 2023-03-31 16:55:13,810 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303317b9e81af38b244ae8baa48ad731f62e8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303317b9e81af38b244ae8baa48ad731f62e8 2023-03-31 16:55:13,810 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331f913f124f4ac4db88bae806a3243f163 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331f913f124f4ac4db88bae806a3243f163 2023-03-31 16:55:14,215 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/e13fb4d494814825b62fe5a3bfb3fb03 2023-03-31 16:55:14,215 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b 2023-03-31 16:55:14,216 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/f52f469495004bb99bb9cfd285598a9c 2023-03-31 16:55:14,630 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303310df2b23a9e1b4aef95eea885e5749636 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303310df2b23a9e1b4aef95eea885e5749636 2023-03-31 16:55:14,631 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303313540884ff13d4467b7f3e94327ef05bb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303313540884ff13d4467b7f3e94327ef05bb 2023-03-31 16:55:14,631 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331b4aa67411c25480d911f55a1f9e00f44 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230331b4aa67411c25480d911f55a1f9e00f44 2023-03-31 16:55:15,035 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/ee13aedf3f49406da370af2a13086ece 2023-03-31 16:55:15,035 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/81dec1c46b6f48b2be476851282f0f2b 2023-03-31 16:55:15,036 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/7e70dd72ed04475190d0d8d7d208803d 2023-03-31 16:55:15,040 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b 2023-03-31 16:55:15,040 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/f52f469495004bb99bb9cfd285598a9c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c 2023-03-31 16:55:15,040 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/e13fb4d494814825b62fe5a3bfb3fb03 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03 2023-03-31 16:55:15,044 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:55:15,044 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:55:15,044 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-31 16:55:15,045 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/ee13aedf3f49406da370af2a13086ece as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece 2023-03-31 16:55:15,045 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/7e70dd72ed04475190d0d8d7d208803d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d 2023-03-31 16:55:15,045 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/81dec1c46b6f48b2be476851282f0f2b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b 2023-03-31 16:55:15,048 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:15,049 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:15,049 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:15,049 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 12d9b8319d30882fd5cfc267a7bc5663 in 1651ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:15,049 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b4efe581f49b013f979767b3126b9e91 in 1650ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:15,049 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-31 16:55:15,049 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 681fb89e6933230e50dee80bd3f2107b in 1650ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:15,049 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-31 16:55:15,050 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:15,051 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-31 16:55:15,051 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-31 16:55:15,054 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,054 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:15,055 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,055 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:15,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-31 16:55:15,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b0a9820[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:15,056 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-31 16:55:15,056 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,057 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,057 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-31 16:55:15,057 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-31 16:55:15,057 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:15,057 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,057 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:15,058 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,058 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-31 16:55:15,058 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:15,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:15,059 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:15,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:15,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-31 16:55:15,061 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-31 16:55:15,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:15,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:15,061 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-31 16:55:15,061 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:15,062 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,062 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:15,062 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,062 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:15,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,063 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:15,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:15,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-31 16:55:15,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-31 16:55:15,067 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:15,067 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,068 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:15,068 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,068 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:15,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:15,068 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:15,168 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:15,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:15,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:15,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:15,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:15,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:15,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:15,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-31 16:55:15,174 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-31 16:55:15,174 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:15,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-31 16:55:15,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-31 16:55:15,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,175 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:15,176 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,176 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:15,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:15,176 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:15,176 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:15,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:15,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-31 16:55:15,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-31 16:55:15,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-31 16:55:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-31 16:55:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:15,177 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. started... 2023-03-31 16:55:15,178 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:15,178 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12d9b8319d30882fd5cfc267a7bc5663 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. started... 2023-03-31 16:55:15,178 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. started... 2023-03-31 16:55:15,178 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:15,178 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b4efe581f49b013f979767b3126b9e91 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:15,178 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 681fb89e6933230e50dee80bd3f2107b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:15,592 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331028d59a9cca94f839789903bff85cb8f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331028d59a9cca94f839789903bff85cb8f 2023-03-31 16:55:15,594 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331db473e3db23744fe8ebb7838b6fc7ab8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230331db473e3db23744fe8ebb7838b6fc7ab8 2023-03-31 16:55:15,594 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331e9b73d77bf8445b4bd84c5e9d7d663f7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230331e9b73d77bf8445b4bd84c5e9d7d663f7 2023-03-31 16:55:15,599 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/015ac8dd8db24dc7b16b3b823c1312ab 2023-03-31 16:55:15,610 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033173743c0f31ff4e52b0e392e7acff7067 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023033173743c0f31ff4e52b0e392e7acff7067 2023-03-31 16:55:15,998 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/05eb5623fc5e405ca53fbec3af7100fb 2023-03-31 16:55:15,998 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/b2fbbb6467ad48fba9b7cec4f06862db 2023-03-31 16:55:16,014 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/de07ab38164442bf9895ab06aa387477 2023-03-31 16:55:16,018 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331a4b631c4816444bab8559e69d6e535e9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230331a4b631c4816444bab8559e69d6e535e9 2023-03-31 16:55:16,019 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/015ac8dd8db24dc7b16b3b823c1312ab as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab 2023-03-31 16:55:16,023 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:55:16,023 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/cfc5da59e13340ad98635808efcf103a 2023-03-31 16:55:16,023 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/de07ab38164442bf9895ab06aa387477 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477 2023-03-31 16:55:16,027 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/05eb5623fc5e405ca53fbec3af7100fb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb 2023-03-31 16:55:16,027 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:16,029 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:55:16,030 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/cfc5da59e13340ad98635808efcf103a as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a 2023-03-31 16:55:16,031 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 681fb89e6933230e50dee80bd3f2107b in 853ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:16,031 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:16,031 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:16,031 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:16,033 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:16,034 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 12d9b8319d30882fd5cfc267a7bc5663 in 856ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:16,034 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:16,034 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:16,034 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:16,416 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033100506ec4b0b948b79e76526179d4cc44 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023033100506ec4b0b948b79e76526179d4cc44 2023-03-31 16:55:16,421 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/aa6d02ce67c6407fb241ba774f547cf5 2023-03-31 16:55:16,425 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/b2fbbb6467ad48fba9b7cec4f06862db as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db 2023-03-31 16:55:16,428 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db, entries=4, sequenceid=9, filesize=5.4 K 2023-03-31 16:55:16,429 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/aa6d02ce67c6407fb241ba774f547cf5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5 2023-03-31 16:55:16,433 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:16,434 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b4efe581f49b013f979767b3126b9e91 in 1256ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:16,434 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:16,434 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-31 16:55:16,434 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-31 16:55:16,435 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:16,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-31 16:55:16,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b850f82[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:16,437 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-31 16:55:16,437 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,438 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-31 16:55:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-31 16:55:16,438 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,438 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:16,438 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:16,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-31 16:55:16,444 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:16,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-31 16:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:16,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:16,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:16,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-31 16:55:16,446 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-31 16:55:16,446 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:16,446 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:16,446 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-31 16:55:16,446 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:16,448 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,448 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:16,448 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:16,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:16,448 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,449 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:16,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:16,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:16,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-31 16:55:16,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:16,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:16,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:16,451 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:16,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:16,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:16,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:16,452 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:16,552 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:16,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:16,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:16,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:16,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:16,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:16,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:16,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-31 16:55:16,558 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-31 16:55:16,558 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:16,558 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-31 16:55:16,558 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-31 16:55:16,559 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,559 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:16,560 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,560 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:16,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:16,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:16,560 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:16,560 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:16,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:16,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:16,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:16,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:16,561 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-31 16:55:16,561 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-31 16:55:16,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-31 16:55:16,561 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-31 16:55:16,561 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:16,561 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-31 16:55:16,561 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:16,561 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. started... 2023-03-31 16:55:16,562 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12d9b8319d30882fd5cfc267a7bc5663 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:16,562 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:16,562 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. started... 2023-03-31 16:55:16,563 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b4efe581f49b013f979767b3126b9e91 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:16,563 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:16,563 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:16,563 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:16,563 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. started... 2023-03-31 16:55:16,563 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 681fb89e6933230e50dee80bd3f2107b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:16,978 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331a6cb110193cb41468ccf50dd127753f1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230331a6cb110193cb41468ccf50dd127753f1 2023-03-31 16:55:16,978 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303315a233c8cc1a24cf7ae4c1ef12d5db496 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303315a233c8cc1a24cf7ae4c1ef12d5db496 2023-03-31 16:55:16,979 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303319212e6d3d7e44d6f8e6938e9efef8a4b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303319212e6d3d7e44d6f8e6938e9efef8a4b 2023-03-31 16:55:16,989 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/8f984ddb72434ab4962b35b2177dc0a9 2023-03-31 16:55:17,390 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/04253d58cc4c4be7be6bbbe06a317e17 2023-03-31 16:55:17,390 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/1281101fd3ac4a18b262e34839b67d8b 2023-03-31 16:55:17,404 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303312e6e69c114e641098e097d9628c69c85 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303312e6e69c114e641098e097d9628c69c85 2023-03-31 16:55:17,803 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303311d533df3d2404e79ae4c71c373c9f4a4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303311d533df3d2404e79ae4c71c373c9f4a4 2023-03-31 16:55:17,804 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303311ba568f741e84137b0ee38fc575a5f76 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303311ba568f741e84137b0ee38fc575a5f76 2023-03-31 16:55:17,808 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/ada62536e97b4a8997fd5afb9119c2d1 2023-03-31 16:55:17,811 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/8f984ddb72434ab4962b35b2177dc0a9 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9 2023-03-31 16:55:17,814 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:55:17,815 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/ada62536e97b4a8997fd5afb9119c2d1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1 2023-03-31 16:55:17,817 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:17,818 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 12d9b8319d30882fd5cfc267a7bc5663 in 1256ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:17,818 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:17,818 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:17,921 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:55:18,208 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/98c52c5bb3a24363ae39b08f994b7ddf 2023-03-31 16:55:18,208 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/d812dc7ad35945d1b302705454dcc371 2023-03-31 16:55:18,212 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/1281101fd3ac4a18b262e34839b67d8b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b 2023-03-31 16:55:18,212 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/04253d58cc4c4be7be6bbbe06a317e17 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17 2023-03-31 16:55:18,216 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:55:18,216 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17, entries=4, sequenceid=13, filesize=5.4 K 2023-03-31 16:55:18,216 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/98c52c5bb3a24363ae39b08f994b7ddf as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf 2023-03-31 16:55:18,217 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/d812dc7ad35945d1b302705454dcc371 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371 2023-03-31 16:55:18,220 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:18,220 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:18,221 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 681fb89e6933230e50dee80bd3f2107b in 1658ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:18,221 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b4efe581f49b013f979767b3126b9e91 in 1658ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:18,221 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:18,221 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:18,221 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:18,221 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-31 16:55:18,221 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-31 16:55:18,222 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,222 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:18,223 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,223 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:18,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-31 16:55:18,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24dc86bc[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:18,224 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-31 16:55:18,224 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,225 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-31 16:55:18,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-31 16:55:18,225 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:18,225 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,225 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:18,226 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-31 16:55:18,226 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:18,226 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,227 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:18,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-31 16:55:18,228 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-31 16:55:18,229 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:18,229 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:18,229 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-31 16:55:18,229 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:18,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:18,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,231 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:18,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:18,231 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,232 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:18,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:18,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:18,234 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:18,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:18,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-31 16:55:18,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:18,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,234 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:18,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:18,235 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:18,335 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:18,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:18,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:18,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:18,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:18,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:18,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:18,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-31 16:55:18,341 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-31 16:55:18,341 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:18,341 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-31 16:55:18,341 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-31 16:55:18,342 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,342 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:18,343 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,343 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:18,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:18,343 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:18,343 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:18,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:18,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-31 16:55:18,344 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-31 16:55:18,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-31 16:55:18,344 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-31 16:55:18,344 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:18,344 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-31 16:55:18,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:18,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. started... 2023-03-31 16:55:18,344 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:18,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:18,344 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12d9b8319d30882fd5cfc267a7bc5663 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:18,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:18,345 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. started... 2023-03-31 16:55:18,344 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. started... 2023-03-31 16:55:18,344 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:18,345 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b4efe581f49b013f979767b3126b9e91 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:18,345 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 681fb89e6933230e50dee80bd3f2107b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:18,756 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033187a38e1cc5c34ba0b765388cf98f4676 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023033187a38e1cc5c34ba0b765388cf98f4676 2023-03-31 16:55:18,757 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303310d266e38129848e8b16987ed44554ab0 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303310d266e38129848e8b16987ed44554ab0 2023-03-31 16:55:18,757 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303319d3379caa013409eb60671ac58b8dc01 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303319d3379caa013409eb60671ac58b8dc01 2023-03-31 16:55:19,166 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/61747788d2a642d987a542e56439fa7d 2023-03-31 16:55:19,169 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/ffb39838ae2e4218b98bd79303687109 2023-03-31 16:55:19,178 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/b9d292d10a6544aca61157922b92a7bc 2023-03-31 16:55:19,187 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331f9d6ca807db941d89d49a100f526e8c6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230331f9d6ca807db941d89d49a100f526e8c6 2023-03-31 16:55:19,203 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303312c878478c6a24d1c87493af6be95b308 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303312c878478c6a24d1c87493af6be95b308 2023-03-31 16:55:19,207 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/c23f1e7211cb40e28873486ed2868db3 2023-03-31 16:55:19,210 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/b9d292d10a6544aca61157922b92a7bc as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc 2023-03-31 16:55:19,214 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:55:19,214 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/c23f1e7211cb40e28873486ed2868db3 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3 2023-03-31 16:55:19,218 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:19,218 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 681fb89e6933230e50dee80bd3f2107b in 873ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:19,218 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:19,218 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:19,218 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:19,589 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303313008d1f8976249ca812bdaa8d72b339a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303313008d1f8976249ca812bdaa8d72b339a 2023-03-31 16:55:19,593 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/b4c57a49c5854f75a1b9bf8f0407dd48 2023-03-31 16:55:19,597 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/61747788d2a642d987a542e56439fa7d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d 2023-03-31 16:55:19,600 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:55:19,601 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/b4c57a49c5854f75a1b9bf8f0407dd48 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48 2023-03-31 16:55:19,605 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:19,605 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b4efe581f49b013f979767b3126b9e91 in 1260ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:19,605 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:19,606 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:19,995 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/4b329fc262ea4ea3a58381c0f0fc417b 2023-03-31 16:55:19,999 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/ffb39838ae2e4218b98bd79303687109 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109 2023-03-31 16:55:20,003 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109, entries=4, sequenceid=17, filesize=5.4 K 2023-03-31 16:55:20,004 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/4b329fc262ea4ea3a58381c0f0fc417b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b 2023-03-31 16:55:20,008 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:20,009 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 12d9b8319d30882fd5cfc267a7bc5663 in 1665ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:20,009 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:20,009 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-31 16:55:20,009 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-31 16:55:20,011 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,011 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-31 16:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61bf5af2[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:20,012 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-31 16:55:20,012 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,014 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,014 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-31 16:55:20,014 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-31 16:55:20,014 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:20,014 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,015 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:20,016 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,016 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-31 16:55:20,016 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:20,016 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-31 16:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:20,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:20,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-31 16:55:20,018 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-31 16:55:20,018 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:20,018 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:20,018 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-31 16:55:20,018 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:20,020 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:20,020 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,020 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:20,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:20,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:20,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,022 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:20,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:20,023 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:20,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:20,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:20,025 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,025 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:20,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:20,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-31 16:55:20,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:20,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:20,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-31 16:55:20,026 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:20,026 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:20,126 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:20,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:20,140 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:20,151 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:20,161 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:20,163 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:20,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:20,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:20,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-31 16:55:20,201 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-31 16:55:20,201 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:20,201 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-31 16:55:20,202 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-31 16:55:20,202 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,202 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:20,204 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:20,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:20,204 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:20,205 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:20,205 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:20,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:20,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-31 16:55:20,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-31 16:55:20,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-31 16:55:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-31 16:55:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. started... 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. started... 2023-03-31 16:55:20,206 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12d9b8319d30882fd5cfc267a7bc5663 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:20,206 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 681fb89e6933230e50dee80bd3f2107b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:20,206 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. started... 2023-03-31 16:55:20,206 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b4efe581f49b013f979767b3126b9e91 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:20,655 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/23c893394f9f420e946e5bba2ebbe174 2023-03-31 16:55:20,656 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/218f94e478d04364a5dad45866caffad 2023-03-31 16:55:20,660 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c893394f9f420e946e5bba2ebbe174 2023-03-31 16:55:20,661 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 218f94e478d04364a5dad45866caffad 2023-03-31 16:55:21,047 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/595ed7058ae143a385cb24649edfb1bf 2023-03-31 16:55:21,051 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 595ed7058ae143a385cb24649edfb1bf 2023-03-31 16:55:21,479 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/76ca089274c94f9dad2267ae23da1343 2023-03-31 16:55:21,484 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76ca089274c94f9dad2267ae23da1343 2023-03-31 16:55:21,485 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/23c893394f9f420e946e5bba2ebbe174 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174 2023-03-31 16:55:21,489 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c893394f9f420e946e5bba2ebbe174 2023-03-31 16:55:21,489 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174, entries=3, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,490 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/5b98d97f4cce4dda91bac425360745c1 2023-03-31 16:55:21,490 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/76ca089274c94f9dad2267ae23da1343 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343 2023-03-31 16:55:21,494 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b98d97f4cce4dda91bac425360745c1 2023-03-31 16:55:21,496 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/218f94e478d04364a5dad45866caffad as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad 2023-03-31 16:55:21,497 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76ca089274c94f9dad2267ae23da1343 2023-03-31 16:55:21,497 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,498 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 12d9b8319d30882fd5cfc267a7bc5663 in 1292ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:21,498 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:21,498 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:21,498 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:21,503 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 218f94e478d04364a5dad45866caffad 2023-03-31 16:55:21,503 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad, entries=3, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,504 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/5b98d97f4cce4dda91bac425360745c1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1 2023-03-31 16:55:21,508 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b98d97f4cce4dda91bac425360745c1 2023-03-31 16:55:21,508 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,509 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b4efe581f49b013f979767b3126b9e91 in 1303ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:21,509 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:21,509 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:21,509 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:21,865 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/c25456c9bc4d4028be1b9fe682957188 2023-03-31 16:55:21,869 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25456c9bc4d4028be1b9fe682957188 2023-03-31 16:55:21,870 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/595ed7058ae143a385cb24649edfb1bf as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf 2023-03-31 16:55:21,873 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 595ed7058ae143a385cb24649edfb1bf 2023-03-31 16:55:21,874 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf, entries=3, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,874 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/c25456c9bc4d4028be1b9fe682957188 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188 2023-03-31 16:55:21,878 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25456c9bc4d4028be1b9fe682957188 2023-03-31 16:55:21,878 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:21,879 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 681fb89e6933230e50dee80bd3f2107b in 1673ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:21,879 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:21,879 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-31 16:55:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-31 16:55:21,881 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,881 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:21,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-31 16:55:21,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e8b057d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:21,883 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-31 16:55:21,883 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,884 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-31 16:55:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-31 16:55:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:21,884 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,884 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:21,889 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-31 16:55:21,889 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:21,889 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,889 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-31 16:55:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:21,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-31 16:55:21,897 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-31 16:55:21,897 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:21,897 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:21,897 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-31 16:55:21,897 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:21,898 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,898 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,899 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:21,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:21,899 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,900 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-31 16:55:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:21,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:21,902 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,903 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:21,903 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-31 16:55:21,903 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-31 16:55:21,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-31 16:55:21,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:21,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-31 16:55:21,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:21,903 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:21,903 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:22,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:22,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:22,005 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:22,005 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 12d9b8319d30882fd5cfc267a7bc5663/family1 is initiating major compaction (all files) 2023-03-31 16:55:22,005 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:22,005 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:22,005 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 12d9b8319d30882fd5cfc267a7bc5663/family1 in ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:22,005 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp, totalSize=26.6 K 2023-03-31 16:55:22,006 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 4fd9700acd7c41fe8a7c6c6ecfde2a4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713390 2023-03-31 16:55:22,007 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 05eb5623fc5e405ca53fbec3af7100fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715170 2023-03-31 16:55:22,007 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 8f984ddb72434ab4962b35b2177dc0a9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:22,008 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting ffb39838ae2e4218b98bd79303687109, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:22,008 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 23c893394f9f420e946e5bba2ebbe174, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:22,019 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 12d9b8319d30882fd5cfc267a7bc5663#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:22,428 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331dba53408e5a64f72b1657a101342ce19_del 2023-03-31 16:55:22,428 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331dba53408e5a64f72b1657a101342ce19_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331dba53408e5a64f72b1657a101342ce19_del 2023-03-31 16:55:22,842 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db3a2f0214f446338cb0f9a6743d4759 2023-03-31 16:55:22,843 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family1/db3a2f0214f446338cb0f9a6743d4759 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/db3a2f0214f446338cb0f9a6743d4759 2023-03-31 16:55:22,846 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db3a2f0214f446338cb0f9a6743d4759 2023-03-31 16:55:22,847 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 12d9b8319d30882fd5cfc267a7bc5663/family1 of 12d9b8319d30882fd5cfc267a7bc5663 into db3a2f0214f446338cb0f9a6743d4759(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:22,847 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:22,847 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:22,847 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 12d9b8319d30882fd5cfc267a7bc5663/family2 is initiating major compaction (all files) 2023-03-31 16:55:22,847 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:22,847 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:22,848 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 12d9b8319d30882fd5cfc267a7bc5663/family2 in ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:22,848 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp, totalSize=25.3 K 2023-03-31 16:55:22,848 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting ee13aedf3f49406da370af2a13086ece, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713390 2023-03-31 16:55:22,848 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting cfc5da59e13340ad98635808efcf103a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715170 2023-03-31 16:55:22,849 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting ada62536e97b4a8997fd5afb9119c2d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:22,849 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 4b329fc262ea4ea3a58381c0f0fc417b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:22,849 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 76ca089274c94f9dad2267ae23da1343, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:22,857 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 12d9b8319d30882fd5cfc267a7bc5663#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:22,864 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303316da2e40b80c84a07b1365387d660c1c0_del 2023-03-31 16:55:22,864 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303316da2e40b80c84a07b1365387d660c1c0_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303316da2e40b80c84a07b1365387d660c1c0_del 2023-03-31 16:55:22,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174] to archive 2023-03-31 16:55:22,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:22,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/4fd9700acd7c41fe8a7c6c6ecfde2a4b 2023-03-31 16:55:22,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/05eb5623fc5e405ca53fbec3af7100fb 2023-03-31 16:55:22,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/8f984ddb72434ab4962b35b2177dc0a9 2023-03-31 16:55:22,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/ffb39838ae2e4218b98bd79303687109 2023-03-31 16:55:22,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/23c893394f9f420e946e5bba2ebbe174 2023-03-31 16:55:23,279 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ee13cb607c48e19d3e660d51ebef7d 2023-03-31 16:55:23,281 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/.tmp/family2/48ee13cb607c48e19d3e660d51ebef7d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/48ee13cb607c48e19d3e660d51ebef7d 2023-03-31 16:55:23,285 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48ee13cb607c48e19d3e660d51ebef7d 2023-03-31 16:55:23,287 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 12d9b8319d30882fd5cfc267a7bc5663/family2 of 12d9b8319d30882fd5cfc267a7bc5663 into 48ee13cb607c48e19d3e660d51ebef7d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:23,287 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:23,287 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:23,287 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): b4efe581f49b013f979767b3126b9e91/family1 is initiating major compaction (all files) 2023-03-31 16:55:23,287 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:23,287 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:23,287 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of b4efe581f49b013f979767b3126b9e91/family1 in ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:23,287 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp, totalSize=26.6 K 2023-03-31 16:55:23,288 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting f52f469495004bb99bb9cfd285598a9c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713389 2023-03-31 16:55:23,288 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b2fbbb6467ad48fba9b7cec4f06862db, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715170 2023-03-31 16:55:23,289 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 04253d58cc4c4be7be6bbbe06a317e17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:23,290 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 61747788d2a642d987a542e56439fa7d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:23,290 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 218f94e478d04364a5dad45866caffad, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:23,300 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): b4efe581f49b013f979767b3126b9e91#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:23,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343] to archive 2023-03-31 16:55:23,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:23,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ee13aedf3f49406da370af2a13086ece 2023-03-31 16:55:23,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/cfc5da59e13340ad98635808efcf103a 2023-03-31 16:55:23,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/ada62536e97b4a8997fd5afb9119c2d1 2023-03-31 16:55:23,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/4b329fc262ea4ea3a58381c0f0fc417b 2023-03-31 16:55:23,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family2/76ca089274c94f9dad2267ae23da1343 2023-03-31 16:55:23,719 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303317ceada00b87143b1a1cca59585f86484_del 2023-03-31 16:55:23,719 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303317ceada00b87143b1a1cca59585f86484_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303317ceada00b87143b1a1cca59585f86484_del 2023-03-31 16:55:24,562 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ef215343e5242ed97438fd753c6fa39 2023-03-31 16:55:24,563 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family1/3ef215343e5242ed97438fd753c6fa39 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/3ef215343e5242ed97438fd753c6fa39 2023-03-31 16:55:24,570 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ef215343e5242ed97438fd753c6fa39 2023-03-31 16:55:24,573 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b4efe581f49b013f979767b3126b9e91/family1 of b4efe581f49b013f979767b3126b9e91 into 3ef215343e5242ed97438fd753c6fa39(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-31 16:55:24,574 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:24,575 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:24,575 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): b4efe581f49b013f979767b3126b9e91/family2 is initiating major compaction (all files) 2023-03-31 16:55:24,575 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:24,575 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:24,577 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of b4efe581f49b013f979767b3126b9e91/family2 in ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:24,577 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp, totalSize=25.3 K 2023-03-31 16:55:24,578 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 81dec1c46b6f48b2be476851282f0f2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713389 2023-03-31 16:55:24,578 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting aa6d02ce67c6407fb241ba774f547cf5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715170 2023-03-31 16:55:24,579 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting d812dc7ad35945d1b302705454dcc371, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:24,580 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b4c57a49c5854f75a1b9bf8f0407dd48, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:24,581 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 5b98d97f4cce4dda91bac425360745c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:24,596 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): b4efe581f49b013f979767b3126b9e91#family2#compaction#152 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:24,612 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331593caeb613c44a0081b1384fd1fda976_del 2023-03-31 16:55:24,612 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331593caeb613c44a0081b1384fd1fda976_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230331593caeb613c44a0081b1384fd1fda976_del 2023-03-31 16:55:24,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad] to archive 2023-03-31 16:55:24,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:24,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f52f469495004bb99bb9cfd285598a9c 2023-03-31 16:55:24,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/b2fbbb6467ad48fba9b7cec4f06862db 2023-03-31 16:55:24,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/04253d58cc4c4be7be6bbbe06a317e17 2023-03-31 16:55:24,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/61747788d2a642d987a542e56439fa7d 2023-03-31 16:55:24,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/218f94e478d04364a5dad45866caffad 2023-03-31 16:55:25,047 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45c4a4f37304840a515ab8ea8d78fe7 2023-03-31 16:55:25,048 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/.tmp/family2/c45c4a4f37304840a515ab8ea8d78fe7 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/c45c4a4f37304840a515ab8ea8d78fe7 2023-03-31 16:55:25,052 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45c4a4f37304840a515ab8ea8d78fe7 2023-03-31 16:55:25,053 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b4efe581f49b013f979767b3126b9e91/family2 of b4efe581f49b013f979767b3126b9e91 into c45c4a4f37304840a515ab8ea8d78fe7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:25,053 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:25,053 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:25,053 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 681fb89e6933230e50dee80bd3f2107b/family1 is initiating major compaction (all files) 2023-03-31 16:55:25,053 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:25,053 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:25,053 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 681fb89e6933230e50dee80bd3f2107b/family1 in ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:25,053 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp, totalSize=26.6 K 2023-03-31 16:55:25,054 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting e13fb4d494814825b62fe5a3bfb3fb03, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713390 2023-03-31 16:55:25,056 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 015ac8dd8db24dc7b16b3b823c1312ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715171 2023-03-31 16:55:25,056 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 1281101fd3ac4a18b262e34839b67d8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:25,057 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b9d292d10a6544aca61157922b92a7bc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:25,057 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 595ed7058ae143a385cb24649edfb1bf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:25,068 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 681fb89e6933230e50dee80bd3f2107b#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:25,082 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023033120a77d1f3eca4aac892a941946d3616c_del 2023-03-31 16:55:25,082 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033120a77d1f3eca4aac892a941946d3616c_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023033120a77d1f3eca4aac892a941946d3616c_del 2023-03-31 16:55:25,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1] to archive 2023-03-31 16:55:25,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:25,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/81dec1c46b6f48b2be476851282f0f2b 2023-03-31 16:55:25,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/aa6d02ce67c6407fb241ba774f547cf5 2023-03-31 16:55:25,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/d812dc7ad35945d1b302705454dcc371 2023-03-31 16:55:25,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/b4c57a49c5854f75a1b9bf8f0407dd48 2023-03-31 16:55:25,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family2/5b98d97f4cce4dda91bac425360745c1 2023-03-31 16:55:25,498 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d31d83e838645b790c546e85e83bee6 2023-03-31 16:55:25,498 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family1/9d31d83e838645b790c546e85e83bee6 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/9d31d83e838645b790c546e85e83bee6 2023-03-31 16:55:25,502 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d31d83e838645b790c546e85e83bee6 2023-03-31 16:55:25,503 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 681fb89e6933230e50dee80bd3f2107b/family1 of 681fb89e6933230e50dee80bd3f2107b into 9d31d83e838645b790c546e85e83bee6(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:25,503 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:25,503 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:25,503 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 681fb89e6933230e50dee80bd3f2107b/family2 is initiating major compaction (all files) 2023-03-31 16:55:25,503 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:25,503 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:25,503 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 681fb89e6933230e50dee80bd3f2107b/family2 in ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:25,503 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp, totalSize=25.3 K 2023-03-31 16:55:25,504 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 7e70dd72ed04475190d0d8d7d208803d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281713390 2023-03-31 16:55:25,504 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting de07ab38164442bf9895ab06aa387477, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281715171 2023-03-31 16:55:25,516 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 98c52c5bb3a24363ae39b08f994b7ddf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281716554 2023-03-31 16:55:25,516 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting c23f1e7211cb40e28873486ed2868db3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281718337 2023-03-31 16:55:25,517 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting c25456c9bc4d4028be1b9fe682957188, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:25,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf] to archive 2023-03-31 16:55:25,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:25,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/e13fb4d494814825b62fe5a3bfb3fb03 2023-03-31 16:55:25,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/015ac8dd8db24dc7b16b3b823c1312ab 2023-03-31 16:55:25,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/1281101fd3ac4a18b262e34839b67d8b 2023-03-31 16:55:25,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/b9d292d10a6544aca61157922b92a7bc 2023-03-31 16:55:25,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/595ed7058ae143a385cb24649edfb1bf 2023-03-31 16:55:25,536 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 681fb89e6933230e50dee80bd3f2107b#family2#compaction#154 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:25,946 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303313088fa66649e416cbe234e85ccfdb3b7_del 2023-03-31 16:55:25,946 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303313088fa66649e416cbe234e85ccfdb3b7_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303313088fa66649e416cbe234e85ccfdb3b7_del 2023-03-31 16:55:25,968 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f868e882a674bb988df67d69cc20be5 2023-03-31 16:55:25,969 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/.tmp/family2/5f868e882a674bb988df67d69cc20be5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/5f868e882a674bb988df67d69cc20be5 2023-03-31 16:55:25,973 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f868e882a674bb988df67d69cc20be5 2023-03-31 16:55:25,974 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 681fb89e6933230e50dee80bd3f2107b/family2 of 681fb89e6933230e50dee80bd3f2107b into 5f868e882a674bb988df67d69cc20be5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:25,974 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:25,978 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:25,981 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:25,985 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:25,985 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:26,000 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:55:26,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188] to archive 2023-03-31 16:55:26,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:26,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/7e70dd72ed04475190d0d8d7d208803d 2023-03-31 16:55:26,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/de07ab38164442bf9895ab06aa387477 2023-03-31 16:55:26,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/98c52c5bb3a24363ae39b08f994b7ddf 2023-03-31 16:55:26,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c23f1e7211cb40e28873486ed2868db3 2023-03-31 16:55:26,030 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-31 16:55:26,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family2/c25456c9bc4d4028be1b9fe682957188 2023-03-31 16:55:26,037 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303317ceada00b87143b1a1cca59585f86484_del 2023-03-31 16:55:26,041 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331dba53408e5a64f72b1657a101342ce19_del 2023-03-31 16:55:26,045 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023033120a77d1f3eca4aac892a941946d3616c_del 2023-03-31 16:55:26,045 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,045 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(139): Connect 0x31672845 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:26,058 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6b685, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:26,059 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,059 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,059 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,124 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303315d2afa008bc546c1a0824d017a0a45a4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303315d2afa008bc546c1a0824d017a0a45a4 2023-03-31 16:55:26,125 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,133 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331a2ad707bb8ad4eb3bdc5f93b469f73b3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230331a2ad707bb8ad4eb3bdc5f93b469f73b3 2023-03-31 16:55:26,134 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,140 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:26,143 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:26,150 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:55:26,160 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:55:26,183 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230331/family1/e9c49aa6e9b74745889dfb3c7cbf4486 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-31 16:55:26,183 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230331/family1/e9c49aa6e9b74745889dfb3c7cbf4486}] 2023-03-31 16:55:26,185 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/family1/6ee4e5cb297a4e0d8c6adafa6d426652 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-31 16:55:26,186 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/family1/6ee4e5cb297a4e0d8c6adafa6d426652}] 2023-03-31 16:55:26,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/family1/6ee4e5cb297a4e0d8c6adafa6d426652 for inclusion in b4efe581f49b013f979767b3126b9e91/family1 2023-03-31 16:55:26,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230331/family1/e9c49aa6e9b74745889dfb3c7cbf4486 for inclusion in 681fb89e6933230e50dee80bd3f2107b/family1 2023-03-31 16:55:26,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-31 16:55:26,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last=1 2023-03-31 16:55:26,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:26,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-31 16:55:26,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-31 16:55:26,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:26,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230331/family1/6ee4e5cb297a4e0d8c6adafa6d426652 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__2lp4iovado5nrtr7gqrsi1afvnfki8k1pfqrfi7v9pjdcil3u6ia3af2doul2qv9/family1/6ee4e5cb297a4e0d8c6adafa6d426652 2023-03-31 16:55:26,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230331/family1/e9c49aa6e9b74745889dfb3c7cbf4486 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__6rrvtails7344fabumm0kh01iohf5nnl1v4v8m7ffhsrmkt2uojpmoi2gm5aohdr/family1/e9c49aa6e9b74745889dfb3c7cbf4486 2023-03-31 16:55:26,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__2lp4iovado5nrtr7gqrsi1afvnfki8k1pfqrfi7v9pjdcil3u6ia3af2doul2qv9/family1/6ee4e5cb297a4e0d8c6adafa6d426652 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f82456d38ea045d882000a8741871a56_SeqId_28_ 2023-03-31 16:55:26,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__6rrvtails7344fabumm0kh01iohf5nnl1v4v8m7ffhsrmkt2uojpmoi2gm5aohdr/family1/e9c49aa6e9b74745889dfb3c7cbf4486 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/258dc67d4cc04c6cabe27612ee473917_SeqId_28_ 2023-03-31 16:55:26,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__2lp4iovado5nrtr7gqrsi1afvnfki8k1pfqrfi7v9pjdcil3u6ia3af2doul2qv9/family1/6ee4e5cb297a4e0d8c6adafa6d426652 into b4efe581f49b013f979767b3126b9e91/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f82456d38ea045d882000a8741871a56_SeqId_28_ - updating store file list. 2023-03-31 16:55:26,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__6rrvtails7344fabumm0kh01iohf5nnl1v4v8m7ffhsrmkt2uojpmoi2gm5aohdr/family1/e9c49aa6e9b74745889dfb3c7cbf4486 into 681fb89e6933230e50dee80bd3f2107b/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/258dc67d4cc04c6cabe27612ee473917_SeqId_28_ - updating store file list. 2023-03-31 16:55:26,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f82456d38ea045d882000a8741871a56_SeqId_28_ into b4efe581f49b013f979767b3126b9e91/family1 2023-03-31 16:55:26,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__2lp4iovado5nrtr7gqrsi1afvnfki8k1pfqrfi7v9pjdcil3u6ia3af2doul2qv9/family1/6ee4e5cb297a4e0d8c6adafa6d426652 into b4efe581f49b013f979767b3126b9e91/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/family1/f82456d38ea045d882000a8741871a56_SeqId_28_) 2023-03-31 16:55:26,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__2lp4iovado5nrtr7gqrsi1afvnfki8k1pfqrfi7v9pjdcil3u6ia3af2doul2qv9/family1/6ee4e5cb297a4e0d8c6adafa6d426652 2023-03-31 16:55:26,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/258dc67d4cc04c6cabe27612ee473917_SeqId_28_ into 681fb89e6933230e50dee80bd3f2107b/family1 2023-03-31 16:55:26,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__6rrvtails7344fabumm0kh01iohf5nnl1v4v8m7ffhsrmkt2uojpmoi2gm5aohdr/family1/e9c49aa6e9b74745889dfb3c7cbf4486 into 681fb89e6933230e50dee80bd3f2107b/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/family1/258dc67d4cc04c6cabe27612ee473917_SeqId_28_) 2023-03-31 16:55:26,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__6rrvtails7344fabumm0kh01iohf5nnl1v4v8m7ffhsrmkt2uojpmoi2gm5aohdr/family1/e9c49aa6e9b74745889dfb3c7cbf4486 2023-03-31 16:55:26,211 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,211 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:26,212 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,212 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:26,214 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303317b9e81af38b244ae8baa48ad731f62e8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303317b9e81af38b244ae8baa48ad731f62e8 2023-03-31 16:55:26,214 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303317eabadfc96874efe9ad701a29a158675 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303317eabadfc96874efe9ad701a29a158675 2023-03-31 16:55:26,214 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-31 16:55:26,215 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230331' 2023-03-31 16:55:26,215 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-31 16:55:26,215 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230331' 2023-03-31 16:55:26,215 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,215 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,533 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331c74906ce3e2b4ee1aec8776ff8ddc577 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331c74906ce3e2b4ee1aec8776ff8ddc577 2023-03-31 16:55:26,534 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,565 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230331/family1/d4c66a085e604fd5a4646b4c60e0acb5 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-31 16:55:26,565 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230331/family1/d4c66a085e604fd5a4646b4c60e0acb5}] 2023-03-31 16:55:26,568 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230331/family1/d4c66a085e604fd5a4646b4c60e0acb5 for inclusion in 12d9b8319d30882fd5cfc267a7bc5663/family1 2023-03-31 16:55:26,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-31 16:55:26,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-31 16:55:26,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:26,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230331/family1/d4c66a085e604fd5a4646b4c60e0acb5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__qr05gpk7ji6001kfqjm6mvfrh0ltsrheeq4906lv7resdf1p2svji2h0fmd87pok/family1/d4c66a085e604fd5a4646b4c60e0acb5 2023-03-31 16:55:26,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__qr05gpk7ji6001kfqjm6mvfrh0ltsrheeq4906lv7resdf1p2svji2h0fmd87pok/family1/d4c66a085e604fd5a4646b4c60e0acb5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/e2fd564e0baf4ee6b8e5a215f1a16000_SeqId_28_ 2023-03-31 16:55:26,574 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__qr05gpk7ji6001kfqjm6mvfrh0ltsrheeq4906lv7resdf1p2svji2h0fmd87pok/family1/d4c66a085e604fd5a4646b4c60e0acb5 into 12d9b8319d30882fd5cfc267a7bc5663/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/e2fd564e0baf4ee6b8e5a215f1a16000_SeqId_28_ - updating store file list. 2023-03-31 16:55:26,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/e2fd564e0baf4ee6b8e5a215f1a16000_SeqId_28_ into 12d9b8319d30882fd5cfc267a7bc5663/family1 2023-03-31 16:55:26,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__qr05gpk7ji6001kfqjm6mvfrh0ltsrheeq4906lv7resdf1p2svji2h0fmd87pok/family1/d4c66a085e604fd5a4646b4c60e0acb5 into 12d9b8319d30882fd5cfc267a7bc5663/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/family1/e2fd564e0baf4ee6b8e5a215f1a16000_SeqId_28_) 2023-03-31 16:55:26,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__ns_testMinorCompaction__qr05gpk7ji6001kfqjm6mvfrh0ltsrheeq4906lv7resdf1p2svji2h0fmd87pok/family1/d4c66a085e604fd5a4646b4c60e0acb5 2023-03-31 16:55:26,580 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,580 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:26,581 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331f913f124f4ac4db88bae806a3243f163 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230331f913f124f4ac4db88bae806a3243f163 2023-03-31 16:55:26,581 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-31 16:55:26,581 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230331' 2023-03-31 16:55:26,582 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230331 for table='ns:testMinorCompaction' and column='family1' 2023-03-31 16:55:26,582 INFO [Listener at localhost/38381] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-31 16:55:26,584 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:26,586 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:26,588 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:26,589 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:26,622 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=255 (was 285), OpenFileDescriptor=637 (was 751), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 415) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3549 (was 3537) - AvailableMemoryMB LEAK? - 2023-03-31 16:55:26,644 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=169, AvailableMemoryMB=3548 2023-03-31 16:55:26,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-31 16:55:26,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:26,648 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:55:26,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-31 16:55:26,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:55:26,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-31 16:55:26,650 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:26,651 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12 empty. 2023-03-31 16:55:26,651 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:26,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-31 16:55:26,658 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-31 16:55:26,660 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d75307803a2d0115061ae5c1a041c12, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:26,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-31 16:55:26,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-31 16:55:27,066 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:27,066 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 9d75307803a2d0115061ae5c1a041c12, disabling compactions & flushes 2023-03-31 16:55:27,067 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. after waiting 0 ms 2023-03-31 16:55:27,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,067 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:27,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:55:27,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281727070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281727070"}]},"ts":"1680281727070"} 2023-03-31 16:55:27,071 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-31 16:55:27,072 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:55:27,072 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281727072"}]},"ts":"1680281727072"} 2023-03-31 16:55:27,073 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-31 16:55:27,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=9d75307803a2d0115061ae5c1a041c12, ASSIGN}] 2023-03-31 16:55:27,077 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=9d75307803a2d0115061ae5c1a041c12, ASSIGN 2023-03-31 16:55:27,078 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=9d75307803a2d0115061ae5c1a041c12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:27,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=9d75307803a2d0115061ae5c1a041c12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:27,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281727229"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281727229"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281727229"}]},"ts":"1680281727229"} 2023-03-31 16:55:27,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 9d75307803a2d0115061ae5c1a041c12, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:27,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-31 16:55:27,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d75307803a2d0115061ae5c1a041c12, NAME => 'testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.', STARTKEY => '', ENDKEY => ''} 2023-03-31 16:55:27,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:27,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,388 INFO [StoreOpener-9d75307803a2d0115061ae5c1a041c12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,390 DEBUG [StoreOpener-9d75307803a2d0115061ae5c1a041c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:27,390 DEBUG [StoreOpener-9d75307803a2d0115061ae5c1a041c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:27,391 INFO [StoreOpener-9d75307803a2d0115061ae5c1a041c12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d75307803a2d0115061ae5c1a041c12 columnFamilyName family1 2023-03-31 16:55:27,392 INFO [StoreOpener-9d75307803a2d0115061ae5c1a041c12-1] regionserver.HStore(310): Store=9d75307803a2d0115061ae5c1a041c12/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:27,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:27,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:27,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d75307803a2d0115061ae5c1a041c12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64012063, jitterRate=-0.046145930886268616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-31 16:55:27,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:27,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., pid=114, masterSystemTime=1680281727382 2023-03-31 16:55:27,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=9d75307803a2d0115061ae5c1a041c12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:27,400 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1680281727400"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281727400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281727400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281727400"}]},"ts":"1680281727400"} 2023-03-31 16:55:27,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-31 16:55:27,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 9d75307803a2d0115061ae5c1a041c12, server=jenkins-hbase4.apache.org,41157,1680281619369 in 170 msec 2023-03-31 16:55:27,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-31 16:55:27,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=9d75307803a2d0115061ae5c1a041c12, ASSIGN in 326 msec 2023-03-31 16:55:27,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:55:27,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281727406"}]},"ts":"1680281727406"} 2023-03-31 16:55:27,407 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-31 16:55:27,409 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:55:27,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 763 msec 2023-03-31 16:55:27,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-31 16:55:27,755 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-31 16:55:27,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:27,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,787 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:27,787 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:27,787 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:27,787 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:27,788 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,788 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,789 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:27,789 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:27,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:27,789 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:27,789 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:27,793 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:27,796 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:27,796 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:27,797 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-31 16:55:28,264 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130dc910bf466ee4d39853b3fc41283569a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc910bf466ee4d39853b3fc41283569a 2023-03-31 16:55:28,273 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/2fe9e2267b0f4e9281ba23a77747a843 2023-03-31 16:55:28,282 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/2fe9e2267b0f4e9281ba23a77747a843 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843 2023-03-31 16:55:28,286 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-31 16:55:28,287 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 490ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:28,287 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:28,288 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:28,288 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:28,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:28,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:28,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:28,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:28,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,291 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:28,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,291 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:28,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:28,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:28,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:28,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d31f031[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:28,293 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:28,293 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,296 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:28,296 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:28,296 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:28,296 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:28,299 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:28,299 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:28,299 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,299 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:28,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:28,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:28,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:28,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:28,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:28,302 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:28,302 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:28,302 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:28,302 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,302 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:28,304 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,304 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:28,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,304 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:28,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,305 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,306 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,309 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:28,309 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:28,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:28,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:28,309 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:28,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:28,309 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,309 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:28,310 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:28,410 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:28,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:28,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:28,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:28,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,418 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:28,418 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:28,418 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:28,418 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:28,418 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,418 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,421 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:28,421 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:28,421 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:28,421 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,422 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:28,423 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:28,423 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:28,423 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:28,423 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-31 16:55:28,862 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128803f44f31ec34b15873e44466df5e251 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128803f44f31ec34b15873e44466df5e251 2023-03-31 16:55:29,268 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/fcc13b79677146bba12df3d8cf847010 2023-03-31 16:55:29,277 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/fcc13b79677146bba12df3d8cf847010 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010 2023-03-31 16:55:29,280 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010, entries=1, sequenceid=9, filesize=5.0 K 2023-03-31 16:55:29,281 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 858ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:29,281 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:29,282 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:29,283 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,283 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:29,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:29,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:29,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:29,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d98644d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:29,285 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:29,285 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,287 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:29,287 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,287 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:29,288 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:29,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:29,288 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:29,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:29,291 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:29,291 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:29,291 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:29,291 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,291 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:29,293 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,293 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:29,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,294 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:29,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,294 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,296 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:29,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:29,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:29,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:29,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:29,298 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,298 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,299 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:29,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:29,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:29,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:29,299 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:29,299 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,299 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,299 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,399 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:29,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,405 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:29,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:29,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:29,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:29,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,405 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,409 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,409 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:29,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:29,409 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:29,409 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,411 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:29,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:29,411 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:29,411 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:29,411 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:29,829 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120197bb8799037f46dbb0783dba4e57ba82 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120197bb8799037f46dbb0783dba4e57ba82 2023-03-31 16:55:30,235 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/7db9ee7938284a6ebe6636d28253ca59 2023-03-31 16:55:30,240 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/7db9ee7938284a6ebe6636d28253ca59 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59 2023-03-31 16:55:30,246 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59, entries=1, sequenceid=13, filesize=4.9 K 2023-03-31 16:55:30,247 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 836ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:30,247 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:30,247 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:30,247 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:30,247 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:30,247 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,247 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:30,247 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:30,250 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,250 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,251 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:30,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66bd5c6[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:30,253 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:30,253 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,254 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:30,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:30,255 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,255 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:30,256 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:30,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:30,256 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:30,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:30,261 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:30,261 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:30,261 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:30,261 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,261 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:30,263 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,263 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,263 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,264 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,265 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:30,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:30,274 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:30,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:30,274 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,275 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,275 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,275 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,275 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:30,275 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:30,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:30,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:30,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:30,375 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:30,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:30,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:30,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:30,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,382 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:30,382 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:30,382 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:30,382 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:30,382 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,382 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,383 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:30,383 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:30,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:30,384 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,384 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:30,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:30,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,385 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,385 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:30,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,385 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:30,385 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:30,385 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:30,385 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:30,385 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:30,385 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:30,385 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:30,385 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:30,802 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d867c19adec0491bad07d89fe074ed80 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205d867c19adec0491bad07d89fe074ed80 2023-03-31 16:55:30,807 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/22d047730b714b0bb64825d58f4bb2d9 2023-03-31 16:55:30,810 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/22d047730b714b0bb64825d58f4bb2d9 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9 2023-03-31 16:55:30,813 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9, entries=1, sequenceid=17, filesize=4.9 K 2023-03-31 16:55:30,814 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 429ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:30,815 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:30,815 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,817 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:30,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c0beccf[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:30,819 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:30,819 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,820 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:30,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:30,820 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:30,820 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,820 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:30,822 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:30,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,822 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,822 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:30,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:30,825 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:30,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:30,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:30,825 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,825 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:30,827 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,827 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,827 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:30,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:30,827 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,834 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,836 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,836 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:30,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:30,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:30,837 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:30,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:30,837 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:30,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:30,937 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:30,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:30,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:30,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:30,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,944 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:30,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:30,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:30,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:30,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,944 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,946 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:30,946 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:30,946 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,946 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,948 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,948 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:30,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:30,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:30,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:30,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:30,948 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:30,948 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:30,948 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:30,948 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:30,959 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288d07a508aebc424787afcca8c39ca36e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288d07a508aebc424787afcca8c39ca36e 2023-03-31 16:55:30,964 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/d159284b513b424ea4d492bb268ca59f 2023-03-31 16:55:30,970 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/d159284b513b424ea4d492bb268ca59f as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f 2023-03-31 16:55:30,973 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f, entries=1, sequenceid=21, filesize=4.9 K 2023-03-31 16:55:30,974 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 26ms, sequenceid=21, compaction requested=true 2023-03-31 16:55:30,974 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:30,974 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:30,974 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:30,974 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:30,974 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,974 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:30,974 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:30,976 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,978 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,978 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:30,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1496d56d[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:30,987 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:30,987 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,988 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:30,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:30,988 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:30,988 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,989 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:30,990 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:30,990 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:30,990 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,990 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:30,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:30,993 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:30,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:30,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:30,993 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,993 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:30,994 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,994 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:30,994 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:30,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,995 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,996 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,002 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:31,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:31,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:31,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:31,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,002 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:31,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,003 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:31,003 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:31,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:31,103 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:31,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:31,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:31,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:31,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,110 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:31,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:31,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:31,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:31,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:31,112 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:31,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:31,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:31,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:31,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:31,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:31,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:31,114 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:31,115 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:31,115 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:31,125 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231dbd88e8edd834ec48ac530cf53ea3d56 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbd88e8edd834ec48ac530cf53ea3d56 2023-03-31 16:55:31,534 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/6ce163ad46234d44b5fbab95bd7ae83a 2023-03-31 16:55:31,542 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/6ce163ad46234d44b5fbab95bd7ae83a as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a 2023-03-31 16:55:31,546 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a, entries=1, sequenceid=25, filesize=4.9 K 2023-03-31 16:55:31,546 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 431ms, sequenceid=25, compaction requested=true 2023-03-31 16:55:31,546 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:31,547 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,548 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:31,549 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,549 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:31,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38f34e24[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:31,550 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:31,550 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,555 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:31,555 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,555 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:31,556 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:31,556 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,556 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:31,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:31,559 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:31,559 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:31,559 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:31,559 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,559 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:31,560 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,561 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:31,561 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:31,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:31,561 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:31,562 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,564 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:31,564 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:31,564 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:31,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:31,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:31,564 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:31,564 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:31,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:31,565 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:31,665 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:31,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:31,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:31,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,671 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:31,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:31,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:31,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:31,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,671 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,674 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,674 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:31,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:31,674 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:31,674 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:31,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:31,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:31,675 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:31,676 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:31,676 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:31,676 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:31,676 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:32,089 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013fa5be34d40d4e73a267d711bd11b442 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fa5be34d40d4e73a267d711bd11b442 2023-03-31 16:55:32,095 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/4d3e422eac9d415482fa58cb3a718632 2023-03-31 16:55:32,100 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/4d3e422eac9d415482fa58cb3a718632 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632 2023-03-31 16:55:32,103 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632, entries=1, sequenceid=29, filesize=4.9 K 2023-03-31 16:55:32,104 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 428ms, sequenceid=29, compaction requested=true 2023-03-31 16:55:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:32,104 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:32,106 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,107 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,107 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:32,108 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:32,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b23039[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:32,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:32,110 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,111 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:32,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,112 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,114 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:32,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:32,118 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:32,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:32,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:32,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,118 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:32,119 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,119 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,119 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,120 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,123 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,125 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,125 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,126 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,125 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:32,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:32,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:32,126 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:32,227 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:32,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:32,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,233 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:32,233 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:32,234 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,234 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,235 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,235 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,236 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,236 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:32,250 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:32,250 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5753ab19 to 127.0.0.1:57785 2023-03-31 16:55:32,250 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:32,251 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:32,251 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31672845 to 127.0.0.1:57785 2023-03-31 16:55:32,251 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:32,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:32,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:32,254 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:32,254 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,254 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:32,254 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:32,271 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b840bcdd770845899048f9c6dfd946d1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b840bcdd770845899048f9c6dfd946d1 2023-03-31 16:55:32,277 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/12619cc76358459f978dee9ffe69664b 2023-03-31 16:55:32,281 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/12619cc76358459f978dee9ffe69664b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b 2023-03-31 16:55:32,284 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b, entries=1, sequenceid=33, filesize=4.9 K 2023-03-31 16:55:32,285 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 31ms, sequenceid=33, compaction requested=true 2023-03-31 16:55:32,285 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:32,285 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:32,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,355 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,355 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:32,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@434cd374[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:32,357 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:32,357 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,358 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,358 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:32,358 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:32,358 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:32,358 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,358 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:32,360 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,360 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,360 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,360 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:32,362 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:32,362 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:32,362 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:32,362 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,362 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:32,369 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,369 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,369 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,370 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,371 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,374 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,374 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,375 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:32,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:32,375 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:32,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,475 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:32,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:32,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:32,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,484 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,484 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,484 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:32,484 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:32,484 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,484 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,486 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,486 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:32,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,488 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:32,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:32,488 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,488 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:32,488 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:32,514 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ef001a9c9fd74d7db3f57e9105d51fec to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907ef001a9c9fd74d7db3f57e9105d51fec 2023-03-31 16:55:32,526 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/6d53759b3eea41079d9a10df8f24cfdb 2023-03-31 16:55:32,530 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/6d53759b3eea41079d9a10df8f24cfdb as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb 2023-03-31 16:55:32,537 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb, entries=1, sequenceid=37, filesize=4.9 K 2023-03-31 16:55:32,538 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 50ms, sequenceid=37, compaction requested=true 2023-03-31 16:55:32,538 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:32,538 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,538 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:32,538 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:32,541 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,542 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,542 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:32,542 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:32,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61535bcd[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:32,544 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:32,545 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,546 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:32,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:32,546 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:32,546 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,546 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:32,548 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,548 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:32,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:32,551 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:32,551 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:32,551 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:32,551 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,551 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:32,553 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,553 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,553 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:32,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,553 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,555 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,558 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:32,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:32,558 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,559 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,559 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,559 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,559 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:32,559 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:32,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:32,659 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:32,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:32,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:32,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:32,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,665 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:32,665 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,666 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-31 16:55:32,666 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-31 16:55:32,666 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,666 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,667 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:32,667 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:32,667 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:32,667 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-31 16:55:32,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-31 16:55:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-31 16:55:32,669 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-31 16:55:32,669 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:32,669 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:32,669 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. started... 2023-03-31 16:55:32,669 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d75307803a2d0115061ae5c1a041c12 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-31 16:55:32,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:55:33,080 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b13cc73a92ad4795b51efc6054725663 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b13cc73a92ad4795b51efc6054725663 2023-03-31 16:55:33,085 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/9aad422e59884450b2a077e84c5f0954 2023-03-31 16:55:33,095 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/9aad422e59884450b2a077e84c5f0954 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954 2023-03-31 16:55:33,099 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954, entries=1, sequenceid=41, filesize=4.9 K 2023-03-31 16:55:33,100 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d75307803a2d0115061ae5c1a041c12 in 431ms, sequenceid=41, compaction requested=true 2023-03-31 16:55:33,100 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:33,101 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:33,101 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-31 16:55:33,101 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-31 16:55:33,101 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,101 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-31 16:55:33,101 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-31 16:55:33,103 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:33,103 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:33,103 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,103 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:33,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-31 16:55:33,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4373bbad[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:33,107 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-31 16:55:33,107 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,108 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-31 16:55:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-31 16:55:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:33,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,108 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-31 16:55:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:33,111 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,111 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-31 16:55:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:33,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-31 16:55:33,115 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-31 16:55:33,115 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:33,115 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:33,115 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,115 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:33,117 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,117 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:33,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,117 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:33,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:33,118 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,120 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:33,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:33,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:33,123 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:33,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-31 16:55:33,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:33,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-31 16:55:33,124 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:33,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:33,123 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:33,124 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:33,124 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,124 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,224 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:33,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:33,226 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-31 16:55:33,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:55:33,228 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:55:33,229 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282333229 2023-03-31 16:55:33,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:55:33,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-31 16:55:33,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-31 16:55:33,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:33,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x55d97229 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:33,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59739f60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:33,240 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:34,086 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010367799d38f0f7498baf7fa8083fd7623c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010367799d38f0f7498baf7fa8083fd7623c 2023-03-31 16:55:34,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:34,101 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:34,103 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:34,109 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:55:34,110 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:55:34,121 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9b6b623125bb48ad969a5a8d0082c130 first=Optional[r5] last=Optional[r6] 2023-03-31 16:55:34,124 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9b6b623125bb48ad969a5a8d0082c130}] 2023-03-31 16:55:34,130 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9b6b623125bb48ad969a5a8d0082c130 for inclusion in 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-31 16:55:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:55:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:34,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/9b6b623125bb48ad969a5a8d0082c130 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nluq0hs4npfg0n1lv6t4gd37ss86itei8djtj4ge4uvephj2p13bisc49ot19f5/family1/9b6b623125bb48ad969a5a8d0082c130 2023-03-31 16:55:34,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nluq0hs4npfg0n1lv6t4gd37ss86itei8djtj4ge4uvephj2p13bisc49ot19f5/family1/9b6b623125bb48ad969a5a8d0082c130 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_ 2023-03-31 16:55:34,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nluq0hs4npfg0n1lv6t4gd37ss86itei8djtj4ge4uvephj2p13bisc49ot19f5/family1/9b6b623125bb48ad969a5a8d0082c130 into 9d75307803a2d0115061ae5c1a041c12/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_ - updating store file list. 2023-03-31 16:55:34,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_ into 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:34,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nluq0hs4npfg0n1lv6t4gd37ss86itei8djtj4ge4uvephj2p13bisc49ot19f5/family1/9b6b623125bb48ad969a5a8d0082c130 into 9d75307803a2d0115061ae5c1a041c12/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_) 2023-03-31 16:55:34,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__nluq0hs4npfg0n1lv6t4gd37ss86itei8djtj4ge4uvephj2p13bisc49ot19f5/family1/9b6b623125bb48ad969a5a8d0082c130 2023-03-31 16:55:34,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-31 16:55:34,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-31 16:55:34,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(1912): 9d75307803a2d0115061ae5c1a041c12/family1 is initiating minor compaction 2023-03-31 16:55:34,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f334a27; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:34,144 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9d75307803a2d0115061ae5c1a041c12/family1 in testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:34,144 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp, totalSize=49.7 K 2023-03-31 16:55:34,144 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting fcc13b79677146bba12df3d8cf847010, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-31 16:55:34,144 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 7db9ee7938284a6ebe6636d28253ca59, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-31 16:55:34,144 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 22d047730b714b0bb64825d58f4bb2d9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting d159284b513b424ea4d492bb268ca59f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 6ce163ad46234d44b5fbab95bd7ae83a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 4d3e422eac9d415482fa58cb3a718632, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 12619cc76358459f978dee9ffe69664b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 6d53759b3eea41079d9a10df8f24cfdb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 9aad422e59884450b2a077e84c5f0954, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-31 16:55:34,145 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 307addc7d12a4d75a70dda2429051802_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-31 16:55:34,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:34,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:34,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fa5be34d40d4e73a267d711bd11b442 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fa5be34d40d4e73a267d711bd11b442 2023-03-31 16:55:34,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b840bcdd770845899048f9c6dfd946d1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b840bcdd770845899048f9c6dfd946d1 2023-03-31 16:55:34,155 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-31 16:55:34,155 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-31 16:55:34,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:34,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:34,248 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9d75307803a2d0115061ae5c1a041c12#family1#compaction#165 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:34,678 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/eef283906d064edea0d5e8eb61616cca as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/eef283906d064edea0d5e8eb61616cca 2023-03-31 16:55:34,683 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9d75307803a2d0115061ae5c1a041c12/family1 of 9d75307803a2d0115061ae5c1a041c12 into eef283906d064edea0d5e8eb61616cca(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:34,683 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:34,684 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1680281734144; duration=0sec 2023-03-31 16:55:34,684 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:34,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123101d3a47b228e4e2b99fe5e2b4f74a939 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123101d3a47b228e4e2b99fe5e2b4f74a939 2023-03-31 16:55:34,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:34,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_] to archive 2023-03-31 16:55:34,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:34,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/fcc13b79677146bba12df3d8cf847010 2023-03-31 16:55:34,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/7db9ee7938284a6ebe6636d28253ca59 2023-03-31 16:55:34,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/22d047730b714b0bb64825d58f4bb2d9 2023-03-31 16:55:34,730 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c223f83432e044c5a5fc5e68d421b0ef first=Optional[r1] last=Optional[r4] 2023-03-31 16:55:34,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d159284b513b424ea4d492bb268ca59f 2023-03-31 16:55:34,731 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c223f83432e044c5a5fc5e68d421b0ef}] 2023-03-31 16:55:34,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c223f83432e044c5a5fc5e68d421b0ef for inclusion in 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:34,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6ce163ad46234d44b5fbab95bd7ae83a 2023-03-31 16:55:34,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-31 16:55:34,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:55:34,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:34,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c223f83432e044c5a5fc5e68d421b0ef to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l6vcr9gifh03ah15ilv5tu8pt1ajut5ar4d6hu9l8g8h7s5esgqjv7h577ir851v/family1/c223f83432e044c5a5fc5e68d421b0ef 2023-03-31 16:55:34,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/4d3e422eac9d415482fa58cb3a718632 2023-03-31 16:55:34,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/12619cc76358459f978dee9ffe69664b 2023-03-31 16:55:34,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l6vcr9gifh03ah15ilv5tu8pt1ajut5ar4d6hu9l8g8h7s5esgqjv7h577ir851v/family1/c223f83432e044c5a5fc5e68d421b0ef as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_ 2023-03-31 16:55:34,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l6vcr9gifh03ah15ilv5tu8pt1ajut5ar4d6hu9l8g8h7s5esgqjv7h577ir851v/family1/c223f83432e044c5a5fc5e68d421b0ef into 9d75307803a2d0115061ae5c1a041c12/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_ - updating store file list. 2023-03-31 16:55:34,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6d53759b3eea41079d9a10df8f24cfdb 2023-03-31 16:55:34,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/9aad422e59884450b2a077e84c5f0954 2023-03-31 16:55:34,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/307addc7d12a4d75a70dda2429051802_SeqId_44_ 2023-03-31 16:55:34,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_ into 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:34,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l6vcr9gifh03ah15ilv5tu8pt1ajut5ar4d6hu9l8g8h7s5esgqjv7h577ir851v/family1/c223f83432e044c5a5fc5e68d421b0ef into 9d75307803a2d0115061ae5c1a041c12/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_) 2023-03-31 16:55:34,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l6vcr9gifh03ah15ilv5tu8pt1ajut5ar4d6hu9l8g8h7s5esgqjv7h577ir851v/family1/c223f83432e044c5a5fc5e68d421b0ef 2023-03-31 16:55:34,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-31 16:55:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-31 16:55:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(1912): 9d75307803a2d0115061ae5c1a041c12/family1 is initiating minor compaction (all files) 2023-03-31 16:55:34,750 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9d75307803a2d0115061ae5c1a041c12/family1 in testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:34,750 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/eef283906d064edea0d5e8eb61616cca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp, totalSize=178.1 K 2023-03-31 16:55:34,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@f68d396; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:34,751 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 2fe9e2267b0f4e9281ba23a77747a843, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842768 2023-03-31 16:55:34,751 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting eef283906d064edea0d5e8eb61616cca, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242768 2023-03-31 16:55:34,752 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] compactions.Compactor(207): Compacting 6056af64f4924a128767921aacc52bab_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242768 2023-03-31 16:55:34,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:34,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:34,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120197bb8799037f46dbb0783dba4e57ba82 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120197bb8799037f46dbb0783dba4e57ba82 2023-03-31 16:55:34,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205d867c19adec0491bad07d89fe074ed80 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205d867c19adec0491bad07d89fe074ed80 2023-03-31 16:55:34,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288d07a508aebc424787afcca8c39ca36e to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288d07a508aebc424787afcca8c39ca36e 2023-03-31 16:55:34,764 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbd88e8edd834ec48ac530cf53ea3d56 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dbd88e8edd834ec48ac530cf53ea3d56 2023-03-31 16:55:34,764 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-31 16:55:34,764 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-31 16:55:34,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:34,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:34,773 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9d75307803a2d0115061ae5c1a041c12#family1#compaction#166 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-03-31 16:55:35,261 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ca6c1230ed384d788629a1c4bdbb1c8a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca6c1230ed384d788629a1c4bdbb1c8a 2023-03-31 16:55:35,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:35,263 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/.tmp/family1/d94180e8c0b3427f8376f69ce72d4ada as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/d94180e8c0b3427f8376f69ce72d4ada 2023-03-31 16:55:35,267 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9d75307803a2d0115061ae5c1a041c12/family1 of 9d75307803a2d0115061ae5c1a041c12 into d94180e8c0b3427f8376f69ce72d4ada(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:35,267 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:35,267 INFO [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1680281734750; duration=0sec 2023-03-31 16:55:35,268 DEBUG [RS:0;jenkins-hbase4:41157-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-31 16:55:35,301 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f432d58173a342719fb731fdc27c026d first=Optional[r00] last=Optional[r8] 2023-03-31 16:55:35,302 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f432d58173a342719fb731fdc27c026d}] 2023-03-31 16:55:35,304 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f432d58173a342719fb731fdc27c026d for inclusion in 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-31 16:55:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last= 2023-03-31 16:55:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f432d58173a342719fb731fdc27c026d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ge98n8lmi5keh7l1hvbq8ehr1ee6ambu2um4caiqt99c4qeubn80l1h4nogcboft/family1/f432d58173a342719fb731fdc27c026d 2023-03-31 16:55:35,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ge98n8lmi5keh7l1hvbq8ehr1ee6ambu2um4caiqt99c4qeubn80l1h4nogcboft/family1/f432d58173a342719fb731fdc27c026d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/8997e27799dd4759b0fd24ae15177078_SeqId_50_ 2023-03-31 16:55:35,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ge98n8lmi5keh7l1hvbq8ehr1ee6ambu2um4caiqt99c4qeubn80l1h4nogcboft/family1/f432d58173a342719fb731fdc27c026d into 9d75307803a2d0115061ae5c1a041c12/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/8997e27799dd4759b0fd24ae15177078_SeqId_50_ - updating store file list. 2023-03-31 16:55:35,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/8997e27799dd4759b0fd24ae15177078_SeqId_50_ into 9d75307803a2d0115061ae5c1a041c12/family1 2023-03-31 16:55:35,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ge98n8lmi5keh7l1hvbq8ehr1ee6ambu2um4caiqt99c4qeubn80l1h4nogcboft/family1/f432d58173a342719fb731fdc27c026d into 9d75307803a2d0115061ae5c1a041c12/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/8997e27799dd4759b0fd24ae15177078_SeqId_50_) 2023-03-31 16:55:35,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ge98n8lmi5keh7l1hvbq8ehr1ee6ambu2um4caiqt99c4qeubn80l1h4nogcboft/family1/f432d58173a342719fb731fdc27c026d 2023-03-31 16:55:35,314 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:35,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:35,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b13cc73a92ad4795b51efc6054725663 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120b13cc73a92ad4795b51efc6054725663 2023-03-31 16:55:35,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/eef283906d064edea0d5e8eb61616cca, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_] to archive 2023-03-31 16:55:35,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:35,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128803f44f31ec34b15873e44466df5e251 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128803f44f31ec34b15873e44466df5e251 2023-03-31 16:55:35,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/2fe9e2267b0f4e9281ba23a77747a843 2023-03-31 16:55:35,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc910bf466ee4d39853b3fc41283569a to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc910bf466ee4d39853b3fc41283569a 2023-03-31 16:55:35,320 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-31 16:55:35,320 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-31 16:55:35,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:35,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:35,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-31 16:55:35,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-31 16:55:35,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:55:35,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/eef283906d064edea0d5e8eb61616cca to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/eef283906d064edea0d5e8eb61616cca 2023-03-31 16:55:35,323 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-31 16:55:35,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.0980 sec 2023-03-31 16:55:35,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_ to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/family1/6056af64f4924a128767921aacc52bab_SeqId_47_ 2023-03-31 16:55:35,619 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=257 (was 255) - Thread LEAK? -, OpenFileDescriptor=646 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=418 (was 438), ProcessCount=169 (was 169), AvailableMemoryMB=3588 (was 3548) - AvailableMemoryMB LEAK? - 2023-03-31 16:55:35,633 INFO [Listener at localhost/38381] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=257, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=418, ProcessCount=169, AvailableMemoryMB=3587 2023-03-31 16:55:35,653 DEBUG [Listener at localhost/38381] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-31 16:55:35,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x87\xE23\xF7\xE4:mF\xB6g\xE3\x09\xF3\xB8&\x9E"\x10\xC2fa.@nH\xC2\x86\x8D\xBAx\x1E\x0AI\xD7*\x10\xFBgt\x10\x14\xE9\x05\xB8\x07\x81\xE9S&9\xE0\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-31 16:55:35,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-31 16:55:35,715 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-31 16:55:35,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-31 16:55:35,715 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-31 16:55:35,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:35,717 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104 empty. 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf empty. 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f empty. 2023-03-31 16:55:35,718 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:35,719 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:35,719 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:35,719 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-31 16:55:35,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:36,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:36,127 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-31 16:55:36,136 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7d94fd29c86b55fba635f4878101dbf, NAME => 'testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x87\xE23\xF7\xE4:mF\xB6g\xE3\x09\xF3\xB8&\x9E"\x10\xC2fa.@nH\xC2\x86\x8D\xBAx\x1E\x0AI\xD7*\x10\xFBgt\x10\x14\xE9\x05\xB8\x07\x81\xE9S&9\xE0\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:36,136 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => d25501d31e081f4b1fbc7283eafcd104, NAME => 'testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x87\xE23\xF7\xE4:mF\xB6g\xE3\x09\xF3\xB8&\x9E"\x10\xC2fa.@nH\xC2\x86\x8D\xBAx\x1E\x0AI\xD7*\x10\xFBgt\x10\x14\xE9\x05\xB8\x07\x81\xE9S&9\xE0\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:36,137 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0f44b94914d47f6c0fa40cc0007aad8f, NAME => 'testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x87\xE23\xF7\xE4:mF\xB6g\xE3\x09\xF3\xB8&\x9E"\x10\xC2fa.@nH\xC2\x86\x8D\xBAx\x1E\x0AI\xD7*\x10\xFBgt\x10\x14\xE9\x05\xB8\x07\x81\xE9S&9\xE0\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/.tmp 2023-03-31 16:55:36,154 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 0f44b94914d47f6c0fa40cc0007aad8f, disabling compactions & flushes 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing d25501d31e081f4b1fbc7283eafcd104, disabling compactions & flushes 2023-03-31 16:55:36,155 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,155 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. after waiting 0 ms 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. after waiting 0 ms 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:36,155 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:36,155 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:36,155 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing d7d94fd29c86b55fba635f4878101dbf, disabling compactions & flushes 2023-03-31 16:55:36,550 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. after waiting 0 ms 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,550 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,550 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:36,552 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-31 16:55:36,553 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680281736553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281736553"}]},"ts":"1680281736553"} 2023-03-31 16:55:36,553 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281736553"}]},"ts":"1680281736553"} 2023-03-31 16:55:36,553 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1680281736553"}]},"ts":"1680281736553"} 2023-03-31 16:55:36,555 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-31 16:55:36,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-31 16:55:36,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281736556"}]},"ts":"1680281736556"} 2023-03-31 16:55:36,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-31 16:55:36,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d7d94fd29c86b55fba635f4878101dbf, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d25501d31e081f4b1fbc7283eafcd104, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f44b94914d47f6c0fa40cc0007aad8f, ASSIGN}] 2023-03-31 16:55:36,562 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d7d94fd29c86b55fba635f4878101dbf, ASSIGN 2023-03-31 16:55:36,563 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f44b94914d47f6c0fa40cc0007aad8f, ASSIGN 2023-03-31 16:55:36,563 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d25501d31e081f4b1fbc7283eafcd104, ASSIGN 2023-03-31 16:55:36,563 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d7d94fd29c86b55fba635f4878101dbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:36,564 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f44b94914d47f6c0fa40cc0007aad8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:36,564 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d25501d31e081f4b1fbc7283eafcd104, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41157,1680281619369; forceNewPlan=false, retain=false 2023-03-31 16:55:36,715 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0f44b94914d47f6c0fa40cc0007aad8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:36,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d7d94fd29c86b55fba635f4878101dbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:36,716 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281736715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281736715"}]},"ts":"1680281736715"} 2023-03-31 16:55:36,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=d25501d31e081f4b1fbc7283eafcd104, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:36,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281736715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281736715"}]},"ts":"1680281736715"} 2023-03-31 16:55:36,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680281736715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1680281736715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1680281736715"}]},"ts":"1680281736715"} 2023-03-31 16:55:36,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 0f44b94914d47f6c0fa40cc0007aad8f, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:36,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure d7d94fd29c86b55fba635f4878101dbf, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:36,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure d25501d31e081f4b1fbc7283eafcd104, server=jenkins-hbase4.apache.org,41157,1680281619369}] 2023-03-31 16:55:36,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:36,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f44b94914d47f6c0fa40cc0007aad8f, NAME => 'testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.', STARTKEY => '2', ENDKEY => ''} 2023-03-31 16:55:36,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,895 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,896 DEBUG [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1 2023-03-31 16:55:36,897 DEBUG [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1 2023-03-31 16:55:36,897 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f44b94914d47f6c0fa40cc0007aad8f columnFamilyName family1 2023-03-31 16:55:36,901 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] regionserver.HStore(310): Store=0f44b94914d47f6c0fa40cc0007aad8f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:36,901 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,904 DEBUG [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2 2023-03-31 16:55:36,904 DEBUG [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2 2023-03-31 16:55:36,905 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f44b94914d47f6c0fa40cc0007aad8f columnFamilyName family2 2023-03-31 16:55:36,906 INFO [StoreOpener-0f44b94914d47f6c0fa40cc0007aad8f-1] regionserver.HStore(310): Store=0f44b94914d47f6c0fa40cc0007aad8f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:36,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:36,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:36,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:36,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f44b94914d47f6c0fa40cc0007aad8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59779495, jitterRate=-0.10921610891819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:36,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:36,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f., pid=120, masterSystemTime=1680281736870 2023-03-31 16:55:36,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:36,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7d94fd29c86b55fba635f4878101dbf, NAME => 'testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.', STARTKEY => '', ENDKEY => '1'} 2023-03-31 16:55:36,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,922 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0f44b94914d47f6c0fa40cc0007aad8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:36,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736922"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281736922"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281736922"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281736922"}]},"ts":"1680281736922"} 2023-03-31 16:55:36,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-03-31 16:55:36,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 0f44b94914d47f6c0fa40cc0007aad8f, server=jenkins-hbase4.apache.org,41157,1680281619369 in 207 msec 2023-03-31 16:55:36,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f44b94914d47f6c0fa40cc0007aad8f, ASSIGN in 366 msec 2023-03-31 16:55:36,955 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,957 DEBUG [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1 2023-03-31 16:55:36,957 DEBUG [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1 2023-03-31 16:55:36,958 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d94fd29c86b55fba635f4878101dbf columnFamilyName family1 2023-03-31 16:55:36,958 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] regionserver.HStore(310): Store=d7d94fd29c86b55fba635f4878101dbf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:36,959 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,961 DEBUG [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2 2023-03-31 16:55:36,961 DEBUG [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2 2023-03-31 16:55:36,961 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7d94fd29c86b55fba635f4878101dbf columnFamilyName family2 2023-03-31 16:55:36,962 INFO [StoreOpener-d7d94fd29c86b55fba635f4878101dbf-1] regionserver.HStore(310): Store=d7d94fd29c86b55fba635f4878101dbf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:36,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:36,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:36,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:36,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7d94fd29c86b55fba635f4878101dbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63035220, jitterRate=-0.06070202589035034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:36,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:36,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf., pid=121, masterSystemTime=1680281736870 2023-03-31 16:55:36,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:36,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:36,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d25501d31e081f4b1fbc7283eafcd104, NAME => 'testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.', STARTKEY => '1', ENDKEY => '2'} 2023-03-31 16:55:36,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d7d94fd29c86b55fba635f4878101dbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:36,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:36,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-31 16:55:36,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1680281736973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281736973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281736973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281736973"}]},"ts":"1680281736973"} 2023-03-31 16:55:36,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:36,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:36,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-03-31 16:55:36,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure d7d94fd29c86b55fba635f4878101dbf, server=jenkins-hbase4.apache.org,41157,1680281619369 in 259 msec 2023-03-31 16:55:36,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d7d94fd29c86b55fba635f4878101dbf, ASSIGN in 420 msec 2023-03-31 16:55:37,008 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:37,010 DEBUG [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1 2023-03-31 16:55:37,010 DEBUG [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1 2023-03-31 16:55:37,010 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d25501d31e081f4b1fbc7283eafcd104 columnFamilyName family1 2023-03-31 16:55:37,011 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] regionserver.HStore(310): Store=d25501d31e081f4b1fbc7283eafcd104/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:37,012 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:37,013 DEBUG [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2 2023-03-31 16:55:37,013 DEBUG [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2 2023-03-31 16:55:37,013 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d25501d31e081f4b1fbc7283eafcd104 columnFamilyName family2 2023-03-31 16:55:37,014 INFO [StoreOpener-d25501d31e081f4b1fbc7283eafcd104-1] regionserver.HStore(310): Store=d25501d31e081f4b1fbc7283eafcd104/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-31 16:55:37,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:37,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:37,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-31 16:55:37,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:37,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-31 16:55:37,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d25501d31e081f4b1fbc7283eafcd104; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70707233, jitterRate=0.0536198765039444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-31 16:55:37,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:37,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104., pid=122, masterSystemTime=1680281736870 2023-03-31 16:55:37,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:37,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:37,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=d25501d31e081f4b1fbc7283eafcd104, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:37,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1680281737024"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1680281737024"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1680281737024"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1680281737024"}]},"ts":"1680281737024"} 2023-03-31 16:55:37,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-31 16:55:37,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure d25501d31e081f4b1fbc7283eafcd104, server=jenkins-hbase4.apache.org,41157,1680281619369 in 307 msec 2023-03-31 16:55:37,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-31 16:55:37,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d25501d31e081f4b1fbc7283eafcd104, ASSIGN in 467 msec 2023-03-31 16:55:37,029 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-31 16:55:37,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1680281737029"}]},"ts":"1680281737029"} 2023-03-31 16:55:37,030 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-31 16:55:37,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-31 16:55:37,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3200 sec 2023-03-31 16:55:37,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-31 16:55:37,822 INFO [Listener at localhost/38381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-31 16:55:37,829 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:37,829 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:37,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:37,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-31 16:55:37,833 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-31 16:55:37,833 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:37,833 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-31 16:55:37,833 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-31 16:55:37,834 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:37,834 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:37,838 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:37,838 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:37,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:37,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:37,839 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:37,839 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:37,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:37,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-31 16:55:37,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-31 16:55:37,840 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-31 16:55:37,840 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:37,840 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-31 16:55:37,841 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:37,841 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. started... 2023-03-31 16:55:37,841 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:37,841 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. started... 2023-03-31 16:55:37,842 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:37,842 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:37,842 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d7d94fd29c86b55fba635f4878101dbf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:37,842 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:37,842 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d25501d31e081f4b1fbc7283eafcd104 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:37,842 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. started... 2023-03-31 16:55:37,843 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f44b94914d47f6c0fa40cc0007aad8f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-31 16:55:37,916 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023033185cef5b11069447c81f846b784fae3ff to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033185cef5b11069447c81f846b784fae3ff 2023-03-31 16:55:37,918 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331ff2b07ebad484648930273b6ad753eb9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230331ff2b07ebad484648930273b6ad753eb9 2023-03-31 16:55:37,920 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331d8702a427d3d44139e16fd39e9ad9a6c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d8702a427d3d44139e16fd39e9ad9a6c 2023-03-31 16:55:37,934 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/119f174d70eb4ad88385b9b1d244cb3c 2023-03-31 16:55:37,942 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/fb3d9979d8f844eda5367e1a7e7b4085 2023-03-31 16:55:37,943 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/63e730f17c8e402eaaf14e33928dfba2 2023-03-31 16:55:37,998 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331a6b77d65a9ff47e3b24e262d726ea4b8 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230331a6b77d65a9ff47e3b24e262d726ea4b8 2023-03-31 16:55:38,019 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/81cb9d85bc0b40e6b38927c78e28b287 2023-03-31 16:55:38,022 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033183cfdf9e2f6d48f6b0b95a2b369d0260 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023033183cfdf9e2f6d48f6b0b95a2b369d0260 2023-03-31 16:55:38,023 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/119f174d70eb4ad88385b9b1d244cb3c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c 2023-03-31 16:55:38,027 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/7f66e76c973b45e585de633a3cb5c6e6 2023-03-31 16:55:38,031 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/63e730f17c8e402eaaf14e33928dfba2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2 2023-03-31 16:55:38,055 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c, entries=4, sequenceid=5, filesize=5.5 K 2023-03-31 16:55:38,055 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2, entries=4, sequenceid=5, filesize=5.5 K 2023-03-31 16:55:38,056 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/81cb9d85bc0b40e6b38927c78e28b287 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287 2023-03-31 16:55:38,056 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/7f66e76c973b45e585de633a3cb5c6e6 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6 2023-03-31 16:55:38,060 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:38,060 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:38,061 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d7d94fd29c86b55fba635f4878101dbf in 219ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:38,061 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d25501d31e081f4b1fbc7283eafcd104 in 219ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:38,061 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-31 16:55:38,061 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-31 16:55:38,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:38,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:38,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:38,063 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:38,063 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:38,063 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:38,413 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331c2d92eb224804059ac6fd1e048e102ac to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230331c2d92eb224804059ac6fd1e048e102ac 2023-03-31 16:55:38,419 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/51d4c940f360441ebc1ae50e57912c4d 2023-03-31 16:55:38,423 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/fb3d9979d8f844eda5367e1a7e7b4085 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085 2023-03-31 16:55:38,449 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085, entries=4, sequenceid=5, filesize=5.5 K 2023-03-31 16:55:38,449 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/51d4c940f360441ebc1ae50e57912c4d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d 2023-03-31 16:55:38,452 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d, entries=2, sequenceid=5, filesize=5.1 K 2023-03-31 16:55:38,453 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0f44b94914d47f6c0fa40cc0007aad8f in 610ms, sequenceid=5, compaction requested=false 2023-03-31 16:55:38,453 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:38,453 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:38,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,454 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-31 16:55:38,454 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-31 16:55:38,455 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,455 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:38,455 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:38,455 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:38,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-31 16:55:38,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2016802[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:38,457 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-31 16:55:38,457 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,459 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-31 16:55:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-31 16:55:38,459 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:38,459 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-31 16:55:38,461 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:38,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-31 16:55:38,463 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-31 16:55:38,463 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:38,463 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:38,463 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-31 16:55:38,463 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:38,464 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,464 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:38,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,464 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:38,465 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,466 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,467 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,467 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:38,467 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:38,467 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:38,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-31 16:55:38,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:38,467 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:38,467 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:38,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:38,468 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:38,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:38,568 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:38,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:38,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:38,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:38,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:38,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:38,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-31 16:55:38,574 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-31 16:55:38,574 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:38,574 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-31 16:55:38,574 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-31 16:55:38,574 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,575 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:38,576 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,576 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:38,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:38,577 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:38,577 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:38,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-31 16:55:38,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-31 16:55:38,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-31 16:55:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-31 16:55:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. started... 2023-03-31 16:55:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:38,578 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d25501d31e081f4b1fbc7283eafcd104 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. started... 2023-03-31 16:55:38,578 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. started... 2023-03-31 16:55:38,578 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d7d94fd29c86b55fba635f4878101dbf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:38,578 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f44b94914d47f6c0fa40cc0007aad8f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-31 16:55:39,021 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303314df07dd5abc744528f86e1dc2a398434 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303314df07dd5abc744528f86e1dc2a398434 2023-03-31 16:55:39,035 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331a05ee47dc16b483982353363a636fac7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a05ee47dc16b483982353363a636fac7 2023-03-31 16:55:39,035 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023033169ed3e00d0b540f19d0de8659378d567 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023033169ed3e00d0b540f19d0de8659378d567 2023-03-31 16:55:39,436 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/f5f7dd2918354e9bb8e6050eb789ea81 2023-03-31 16:55:39,450 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/a51e64f8916a410f9a58ced6cf063c69 2023-03-31 16:55:39,450 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/f148c7c1c42e477eb01d28a9dfb04595 2023-03-31 16:55:39,471 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331cc1234f442e449f9893b220d8043ac15 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230331cc1234f442e449f9893b220d8043ac15 2023-03-31 16:55:39,479 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/aa6d116a8a374b84bf2e4554120e75ff 2023-03-31 16:55:39,483 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/f5f7dd2918354e9bb8e6050eb789ea81 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81 2023-03-31 16:55:39,502 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331f7b7d66deab64ed78e7d47503e815869 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230331f7b7d66deab64ed78e7d47503e815869 2023-03-31 16:55:39,513 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81, entries=4, sequenceid=9, filesize=5.5 K 2023-03-31 16:55:39,514 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/aa6d116a8a374b84bf2e4554120e75ff as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff 2023-03-31 16:55:39,517 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:39,517 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d25501d31e081f4b1fbc7283eafcd104 in 939ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:39,518 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:39,518 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:39,518 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:39,902 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331c42eadbcca6f4fd4b82542b2ce265334 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230331c42eadbcca6f4fd4b82542b2ce265334 2023-03-31 16:55:39,909 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/b5a03f8ed10344ebb73ff4a059ba0e2d 2023-03-31 16:55:39,912 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/f148c7c1c42e477eb01d28a9dfb04595 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595 2023-03-31 16:55:39,934 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595, entries=4, sequenceid=9, filesize=5.5 K 2023-03-31 16:55:39,935 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/b5a03f8ed10344ebb73ff4a059ba0e2d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d 2023-03-31 16:55:39,938 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:39,939 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d7d94fd29c86b55fba635f4878101dbf in 1360ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:39,939 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:39,939 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:40,306 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/b5061927ba534324932268785db4dc35 2023-03-31 16:55:40,310 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/a51e64f8916a410f9a58ced6cf063c69 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69 2023-03-31 16:55:40,333 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69, entries=4, sequenceid=9, filesize=5.5 K 2023-03-31 16:55:40,333 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/b5061927ba534324932268785db4dc35 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35 2023-03-31 16:55:40,337 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35, entries=2, sequenceid=9, filesize=5.1 K 2023-03-31 16:55:40,337 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0f44b94914d47f6c0fa40cc0007aad8f in 1759ms, sequenceid=9, compaction requested=false 2023-03-31 16:55:40,337 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:40,338 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:40,338 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:40,338 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:40,338 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,338 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-31 16:55:40,338 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-31 16:55:40,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,339 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:40,339 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:40,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-31 16:55:40,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27f3dc45[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:40,341 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-31 16:55:40,341 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,342 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-31 16:55:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-31 16:55:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:40,342 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,342 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-31 16:55:40,343 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-31 16:55:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:40,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-31 16:55:40,345 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-31 16:55:40,345 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:40,345 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:40,345 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-31 16:55:40,346 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:40,347 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,347 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:40,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,348 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:40,348 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,349 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:40,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:40,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-31 16:55:40,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:40,351 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:40,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:40,351 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:40,352 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:40,352 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,452 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:40,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:40,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:40,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:40,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:40,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:40,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:40,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-31 16:55:40,458 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-31 16:55:40,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:40,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-31 16:55:40,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-31 16:55:40,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:40,459 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:40,459 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:40,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:40,460 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:40,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:40,461 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-31 16:55:40,461 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-31 16:55:40,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-31 16:55:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-31 16:55:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-31 16:55:40,461 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:40,461 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:40,461 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:40,461 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:40,461 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. started... 2023-03-31 16:55:40,462 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. started... 2023-03-31 16:55:40,461 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. started... 2023-03-31 16:55:40,462 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f44b94914d47f6c0fa40cc0007aad8f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:40,462 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d7d94fd29c86b55fba635f4878101dbf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:40,462 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d25501d31e081f4b1fbc7283eafcd104 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-31 16:55:40,513 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331d96ff17c3dd04466ab49478629cfd864 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d96ff17c3dd04466ab49478629cfd864 2023-03-31 16:55:40,523 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303314237997e0a3a41afa441a57115749214 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303314237997e0a3a41afa441a57115749214 2023-03-31 16:55:40,523 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303311f2da7e8095f4ac7b4ac25dc27323973 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303311f2da7e8095f4ac7b4ac25dc27323973 2023-03-31 16:55:40,538 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/ab592fc1b5f6452180e64d6bb279e674 2023-03-31 16:55:40,570 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331c1c4e2f0592d4532b4cec2306434d49f to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230331c1c4e2f0592d4532b4cec2306434d49f 2023-03-31 16:55:40,934 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/69d466a74e2f40ad965d22383d7f6867 2023-03-31 16:55:40,945 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/abccaef6708c4d60962ab9281e3aadb1 2023-03-31 16:55:40,977 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/0970d1c8127e4b58be49b41ac5c92c17 2023-03-31 16:55:40,980 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/ab592fc1b5f6452180e64d6bb279e674 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674 2023-03-31 16:55:41,003 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674, entries=4, sequenceid=13, filesize=5.5 K 2023-03-31 16:55:41,003 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/0970d1c8127e4b58be49b41ac5c92c17 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17 2023-03-31 16:55:41,007 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:41,007 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d7d94fd29c86b55fba635f4878101dbf in 545ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:41,007 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:41,007 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:41,007 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:41,367 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331d7bd80d5fca3438d868bd344d1b62c6b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230331d7bd80d5fca3438d868bd344d1b62c6b 2023-03-31 16:55:41,375 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303319d984790a1d94c45874a2405bb859184 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303319d984790a1d94c45874a2405bb859184 2023-03-31 16:55:41,772 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/cda0ee0a65334a75b1617a045b75f4c4 2023-03-31 16:55:41,775 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/69d466a74e2f40ad965d22383d7f6867 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867 2023-03-31 16:55:41,779 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/86c6f2ffbfec4780a7b457530c3de747 2023-03-31 16:55:41,783 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/abccaef6708c4d60962ab9281e3aadb1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1 2023-03-31 16:55:41,799 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867, entries=4, sequenceid=13, filesize=5.5 K 2023-03-31 16:55:41,799 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/cda0ee0a65334a75b1617a045b75f4c4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4 2023-03-31 16:55:41,803 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:41,803 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d25501d31e081f4b1fbc7283eafcd104 in 1341ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:41,803 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:41,803 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:41,804 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1, entries=4, sequenceid=13, filesize=5.5 K 2023-03-31 16:55:41,805 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/86c6f2ffbfec4780a7b457530c3de747 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747 2023-03-31 16:55:41,808 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747, entries=2, sequenceid=13, filesize=5.1 K 2023-03-31 16:55:41,808 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0f44b94914d47f6c0fa40cc0007aad8f in 1346ms, sequenceid=13, compaction requested=true 2023-03-31 16:55:41,808 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:41,808 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:41,809 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:41,809 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,809 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-31 16:55:41,809 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-31 16:55:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,810 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:41,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-31 16:55:41,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c857645[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:41,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-31 16:55:41,812 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,814 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-31 16:55:41,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-31 16:55:41,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,814 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:41,814 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:41,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-31 16:55:41,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:41,815 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,815 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-31 16:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:41,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-31 16:55:41,817 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-31 16:55:41,817 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:41,817 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:41,817 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-31 16:55:41,817 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:41,818 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,818 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,818 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:41,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:41,819 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:41,820 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:41,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,822 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:41,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-31 16:55:41,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:41,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:41,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:41,822 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,922 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:41,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:41,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:41,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:41,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-31 16:55:41,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:41,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:41,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-31 16:55:41,928 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-31 16:55:41,928 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:41,928 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-31 16:55:41,928 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-31 16:55:41,928 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,928 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:41,935 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:41,935 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:41,935 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:41,935 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:41,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:41,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-31 16:55:41,936 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-31 16:55:41,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-31 16:55:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-31 16:55:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. started... 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. started... 2023-03-31 16:55:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:41,936 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d7d94fd29c86b55fba635f4878101dbf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:41,936 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f44b94914d47f6c0fa40cc0007aad8f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:41,936 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. started... 2023-03-31 16:55:41,937 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d25501d31e081f4b1fbc7283eafcd104 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-31 16:55:41,976 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331b7284d1d56094584b14ce8e56fc50cc3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331b7284d1d56094584b14ce8e56fc50cc3 2023-03-31 16:55:42,374 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-31 16:55:42,382 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331a151d618624047e4bd9b2a424974ba50 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331a151d618624047e4bd9b2a424974ba50 2023-03-31 16:55:42,383 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303316cfda549ff5e465fa55965f9b43fcee1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303316cfda549ff5e465fa55965f9b43fcee1 2023-03-31 16:55:42,390 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/909bbda93607494baa206c77f8947e22 2023-03-31 16:55:42,405 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/9a6cff1f4c56431e9441119ae298cd92 2023-03-31 16:55:42,427 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331123068e742e24b219a740eba2b806d03 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230331123068e742e24b219a740eba2b806d03 2023-03-31 16:55:42,437 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/f25ab4ea2cd14b20875cd0bec2af07c2 2023-03-31 16:55:42,441 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/909bbda93607494baa206c77f8947e22 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22 2023-03-31 16:55:42,444 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331c21d320590404a13a1b67f13c16f6962 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230331c21d320590404a13a1b67f13c16f6962 2023-03-31 16:55:42,466 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22, entries=4, sequenceid=17, filesize=5.5 K 2023-03-31 16:55:42,467 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/f25ab4ea2cd14b20875cd0bec2af07c2 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2 2023-03-31 16:55:42,470 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:42,471 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d7d94fd29c86b55fba635f4878101dbf in 535ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:42,471 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:42,471 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:42,804 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/be301b132ca04081ae75c4773f03641b 2023-03-31 16:55:42,850 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/84df017b3baa414298b595df67841d40 2023-03-31 16:55:42,853 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/9a6cff1f4c56431e9441119ae298cd92 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92 2023-03-31 16:55:42,880 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92, entries=4, sequenceid=17, filesize=5.5 K 2023-03-31 16:55:42,881 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/84df017b3baa414298b595df67841d40 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40 2023-03-31 16:55:42,885 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:42,886 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0f44b94914d47f6c0fa40cc0007aad8f in 950ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:42,886 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:42,886 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:42,886 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:43,236 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023033197c562351b62470f903f5721bd150eac to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023033197c562351b62470f903f5721bd150eac 2023-03-31 16:55:43,641 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/a40c55963a46429a82a8c3c637a7e74d 2023-03-31 16:55:43,644 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/be301b132ca04081ae75c4773f03641b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b 2023-03-31 16:55:43,675 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b, entries=4, sequenceid=17, filesize=5.5 K 2023-03-31 16:55:43,676 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/a40c55963a46429a82a8c3c637a7e74d as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d 2023-03-31 16:55:43,680 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d, entries=2, sequenceid=17, filesize=5.1 K 2023-03-31 16:55:43,681 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d25501d31e081f4b1fbc7283eafcd104 in 1744ms, sequenceid=17, compaction requested=true 2023-03-31 16:55:43,681 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:43,681 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:43,681 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-31 16:55:43,682 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-31 16:55:43,683 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,683 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:43,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-31 16:55:43,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27500ab[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:43,688 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-31 16:55:43,688 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,690 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,690 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:43,690 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-31 16:55:43,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-31 16:55:43,690 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-31 16:55:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-31 16:55:43,696 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:43,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-31 16:55:43,699 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-31 16:55:43,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:43,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:43,699 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-31 16:55:43,699 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:43,701 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,702 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:43,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:43,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:43,702 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:43,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,704 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:43,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:43,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:43,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-31 16:55:43,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-31 16:55:43,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:43,706 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:43,707 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:43,706 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:43,707 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:43,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:43,807 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:43,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:43,818 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:43,824 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:43,833 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:43,834 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:43,961 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:43,961 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55d97229 to 127.0.0.1:57785 2023-03-31 16:55:43,961 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:43,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-31 16:55:43,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-31 16:55:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-31 16:55:43,974 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-31 16:55:43,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:43,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-31 16:55:43,974 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-31 16:55:44,063 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:44,063 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:44,064 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:44,064 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:44,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:44,065 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:44,065 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-31 16:55:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:44,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:44,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-31 16:55:44,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:44,066 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-31 16:55:44,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-31 16:55:44,066 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-31 16:55:44,066 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-31 16:55:44,066 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-31 16:55:44,066 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. started... 2023-03-31 16:55:44,067 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-31 16:55:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:44,067 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d25501d31e081f4b1fbc7283eafcd104 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. started... 2023-03-31 16:55:44,067 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-31 16:55:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:44,067 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f44b94914d47f6c0fa40cc0007aad8f 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:44,067 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. started... 2023-03-31 16:55:44,067 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d7d94fd29c86b55fba635f4878101dbf 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-31 16:55:44,517 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/5e0fc31ae1a44cb0a5b2239683a516a5 2023-03-31 16:55:44,526 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/9022c4cc839a4f2bbab482aef6b68ab9 2023-03-31 16:55:44,526 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/7e3c25948927496792cf24d0b45bf1d4 2023-03-31 16:55:44,545 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e0fc31ae1a44cb0a5b2239683a516a5 2023-03-31 16:55:44,563 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9022c4cc839a4f2bbab482aef6b68ab9 2023-03-31 16:55:44,563 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e3c25948927496792cf24d0b45bf1d4 2023-03-31 16:55:44,586 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/89c9ce43983145a68f3b1154c9a2524b 2023-03-31 16:55:44,590 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89c9ce43983145a68f3b1154c9a2524b 2023-03-31 16:55:44,590 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/5e0fc31ae1a44cb0a5b2239683a516a5 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5 2023-03-31 16:55:44,596 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/6773ad0d8ca548b5b3953d5bc1b44432 2023-03-31 16:55:44,599 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6773ad0d8ca548b5b3953d5bc1b44432 2023-03-31 16:55:44,600 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/9022c4cc839a4f2bbab482aef6b68ab9 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9 2023-03-31 16:55:44,622 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e0fc31ae1a44cb0a5b2239683a516a5 2023-03-31 16:55:44,622 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5, entries=3, sequenceid=23, filesize=5.2 K 2023-03-31 16:55:44,623 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/89c9ce43983145a68f3b1154c9a2524b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b 2023-03-31 16:55:44,628 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89c9ce43983145a68f3b1154c9a2524b 2023-03-31 16:55:44,628 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:44,628 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0f44b94914d47f6c0fa40cc0007aad8f in 561ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:44,629 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:44,629 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-31 16:55:44,632 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9022c4cc839a4f2bbab482aef6b68ab9 2023-03-31 16:55:44,632 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9, entries=3, sequenceid=23, filesize=5.2 K 2023-03-31 16:55:44,636 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/6773ad0d8ca548b5b3953d5bc1b44432 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432 2023-03-31 16:55:44,640 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6773ad0d8ca548b5b3953d5bc1b44432 2023-03-31 16:55:44,640 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:44,640 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d25501d31e081f4b1fbc7283eafcd104 in 573ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:44,641 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:44,641 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:44,641 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-31 16:55:45,393 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/177a75aa4a4543b98c789a9a484a0008 2023-03-31 16:55:45,397 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 177a75aa4a4543b98c789a9a484a0008 2023-03-31 16:55:45,398 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/7e3c25948927496792cf24d0b45bf1d4 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4 2023-03-31 16:55:45,437 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e3c25948927496792cf24d0b45bf1d4 2023-03-31 16:55:45,437 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4, entries=3, sequenceid=23, filesize=5.2 K 2023-03-31 16:55:45,438 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/177a75aa4a4543b98c789a9a484a0008 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008 2023-03-31 16:55:45,443 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 177a75aa4a4543b98c789a9a484a0008 2023-03-31 16:55:45,443 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008, entries=1, sequenceid=23, filesize=5.0 K 2023-03-31 16:55:45,444 INFO [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d7d94fd29c86b55fba635f4878101dbf in 1377ms, sequenceid=23, compaction requested=true 2023-03-31 16:55:45,444 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:45,444 DEBUG [rs(jenkins-hbase4.apache.org,41157,1680281619369)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-31 16:55:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-31 16:55:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-31 16:55:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-31 16:55:45,447 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-31 16:55:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:45,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41157,1680281619369' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-31 16:55:45,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bbd399f[Count = 0] remaining members to acquire global barrier 2023-03-31 16:55:45,449 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-31 16:55:45,449 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,451 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-31 16:55:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-31 16:55:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41157,1680281619369' in zk 2023-03-31 16:55:45,451 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,451 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-31 16:55:45,453 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-31 16:55:45,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:45,453 DEBUG [member: 'jenkins-hbase4.apache.org,41157,1680281619369' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-31 16:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:45,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41157,1680281619369': 2023-03-31 16:55:45,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41157,1680281619369' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-31 16:55:45,458 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-31 16:55:45,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-31 16:55:45,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-31 16:55:45,458 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-31 16:55:45,458 INFO [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-31 16:55:45,460 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,460 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:45,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,460 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-31 16:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-31 16:55:45,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:45,461 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-31 16:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-31 16:55:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,462 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-31 16:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-31 16:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-31 16:55:45,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-31 16:55:45,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-31 16:55:45,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-31 16:55:45,469 DEBUG [(jenkins-hbase4.apache.org,46457,1680281617823)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-31 16:55:45,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-31 16:55:45,469 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-31 16:55:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-31 16:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-31 16:55:45,470 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-31 16:55:45,570 DEBUG [Listener at localhost/38381] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-31 16:55:45,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46457] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-31 16:55:45,571 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:45,571 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): d25501d31e081f4b1fbc7283eafcd104/family1 is initiating major compaction (all files) 2023-03-31 16:55:45,571 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:45,572 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:45,572 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of d25501d31e081f4b1fbc7283eafcd104/family1 in testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:45,573 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp, totalSize=27.1 K 2023-03-31 16:55:45,573 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 63e730f17c8e402eaaf14e33928dfba2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737829 2023-03-31 16:55:45,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting f5f7dd2918354e9bb8e6050eb789ea81, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:45,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 69d466a74e2f40ad965d22383d7f6867, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740454 2023-03-31 16:55:45,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting be301b132ca04081ae75c4773f03641b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:45,575 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 9022c4cc839a4f2bbab482aef6b68ab9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:45,587 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): d25501d31e081f4b1fbc7283eafcd104#family1#compaction#197 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:45,638 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del 2023-03-31 16:55:45,638 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del 2023-03-31 16:55:46,127 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0845985f3d4490baae3ce5424de0260 2023-03-31 16:55:46,128 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family1/b0845985f3d4490baae3ce5424de0260 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/b0845985f3d4490baae3ce5424de0260 2023-03-31 16:55:46,161 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0845985f3d4490baae3ce5424de0260 2023-03-31 16:55:46,163 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d25501d31e081f4b1fbc7283eafcd104/family1 of d25501d31e081f4b1fbc7283eafcd104 into b0845985f3d4490baae3ce5424de0260(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:46,163 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:46,163 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:46,163 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): d25501d31e081f4b1fbc7283eafcd104/family2 is initiating major compaction (all files) 2023-03-31 16:55:46,163 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:46,163 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:46,165 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of d25501d31e081f4b1fbc7283eafcd104/family2 in testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:46,166 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp, totalSize=25.4 K 2023-03-31 16:55:46,166 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 7f66e76c973b45e585de633a3cb5c6e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737829 2023-03-31 16:55:46,166 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting aa6d116a8a374b84bf2e4554120e75ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:46,167 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting cda0ee0a65334a75b1617a045b75f4c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740454 2023-03-31 16:55:46,167 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting a40c55963a46429a82a8c3c637a7e74d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:46,167 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 6773ad0d8ca548b5b3953d5bc1b44432, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:46,178 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): d25501d31e081f4b1fbc7283eafcd104#family2#compaction#198 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:46,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9] to archive 2023-03-31 16:55:46,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:46,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/63e730f17c8e402eaaf14e33928dfba2 2023-03-31 16:55:46,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/f5f7dd2918354e9bb8e6050eb789ea81 2023-03-31 16:55:46,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/69d466a74e2f40ad965d22383d7f6867 2023-03-31 16:55:46,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/be301b132ca04081ae75c4773f03641b 2023-03-31 16:55:46,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/9022c4cc839a4f2bbab482aef6b68ab9 2023-03-31 16:55:46,586 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331fd92fa3624a04351ad29153dc8221b38_del 2023-03-31 16:55:46,587 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230331fd92fa3624a04351ad29153dc8221b38_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230331fd92fa3624a04351ad29153dc8221b38_del 2023-03-31 16:55:46,598 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58425a632f764b96acdef3bc64818e84 2023-03-31 16:55:46,598 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/.tmp/family2/58425a632f764b96acdef3bc64818e84 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/58425a632f764b96acdef3bc64818e84 2023-03-31 16:55:46,601 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58425a632f764b96acdef3bc64818e84 2023-03-31 16:55:46,602 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d25501d31e081f4b1fbc7283eafcd104/family2 of d25501d31e081f4b1fbc7283eafcd104 into 58425a632f764b96acdef3bc64818e84(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:46,602 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:46,602 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:46,602 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): d7d94fd29c86b55fba635f4878101dbf/family1 is initiating major compaction (all files) 2023-03-31 16:55:46,602 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:46,603 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:46,603 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of d7d94fd29c86b55fba635f4878101dbf/family1 in testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:46,603 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp, totalSize=27.1 K 2023-03-31 16:55:46,603 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 119f174d70eb4ad88385b9b1d244cb3c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737829 2023-03-31 16:55:46,605 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting f148c7c1c42e477eb01d28a9dfb04595, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:46,606 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting ab592fc1b5f6452180e64d6bb279e674, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740453 2023-03-31 16:55:46,606 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 909bbda93607494baa206c77f8947e22, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:46,606 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 7e3c25948927496792cf24d0b45bf1d4, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:46,615 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): d7d94fd29c86b55fba635f4878101dbf#family1#compaction#199 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:46,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432] to archive 2023-03-31 16:55:46,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:46,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/7f66e76c973b45e585de633a3cb5c6e6 2023-03-31 16:55:46,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/aa6d116a8a374b84bf2e4554120e75ff 2023-03-31 16:55:46,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/cda0ee0a65334a75b1617a045b75f4c4 2023-03-31 16:55:46,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/a40c55963a46429a82a8c3c637a7e74d 2023-03-31 16:55:46,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family2/6773ad0d8ca548b5b3953d5bc1b44432 2023-03-31 16:55:46,669 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del 2023-03-31 16:55:46,669 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del 2023-03-31 16:55:47,149 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f23cdd66792d4638bd674f222c0304ff 2023-03-31 16:55:47,150 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family1/f23cdd66792d4638bd674f222c0304ff as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f23cdd66792d4638bd674f222c0304ff 2023-03-31 16:55:47,176 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f23cdd66792d4638bd674f222c0304ff 2023-03-31 16:55:47,177 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d7d94fd29c86b55fba635f4878101dbf/family1 of d7d94fd29c86b55fba635f4878101dbf into f23cdd66792d4638bd674f222c0304ff(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:47,177 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:47,177 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:47,177 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): d7d94fd29c86b55fba635f4878101dbf/family2 is initiating major compaction (all files) 2023-03-31 16:55:47,177 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:47,177 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:47,178 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of d7d94fd29c86b55fba635f4878101dbf/family2 in testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:47,178 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp, totalSize=25.4 K 2023-03-31 16:55:47,178 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 81cb9d85bc0b40e6b38927c78e28b287, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737829 2023-03-31 16:55:47,179 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b5a03f8ed10344ebb73ff4a059ba0e2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:47,179 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 0970d1c8127e4b58be49b41ac5c92c17, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740453 2023-03-31 16:55:47,180 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting f25ab4ea2cd14b20875cd0bec2af07c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:47,180 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 177a75aa4a4543b98c789a9a484a0008, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:47,188 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): d7d94fd29c86b55fba635f4878101dbf#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:47,201 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331c4fc73536d9448d9a43fb8389ab09286_del 2023-03-31 16:55:47,201 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331c4fc73536d9448d9a43fb8389ab09286_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230331c4fc73536d9448d9a43fb8389ab09286_del 2023-03-31 16:55:47,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4] to archive 2023-03-31 16:55:47,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:47,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/119f174d70eb4ad88385b9b1d244cb3c 2023-03-31 16:55:47,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/f148c7c1c42e477eb01d28a9dfb04595 2023-03-31 16:55:47,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/ab592fc1b5f6452180e64d6bb279e674 2023-03-31 16:55:47,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/909bbda93607494baa206c77f8947e22 2023-03-31 16:55:47,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/7e3c25948927496792cf24d0b45bf1d4 2023-03-31 16:55:48,016 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d53063036cc477682c01297404d8c63 2023-03-31 16:55:48,017 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/.tmp/family2/5d53063036cc477682c01297404d8c63 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/5d53063036cc477682c01297404d8c63 2023-03-31 16:55:48,020 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d53063036cc477682c01297404d8c63 2023-03-31 16:55:48,021 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d7d94fd29c86b55fba635f4878101dbf/family2 of d7d94fd29c86b55fba635f4878101dbf into 5d53063036cc477682c01297404d8c63(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:48,021 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:48,021 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:48,021 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 0f44b94914d47f6c0fa40cc0007aad8f/family1 is initiating major compaction (all files) 2023-03-31 16:55:48,021 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:48,021 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:48,022 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 0f44b94914d47f6c0fa40cc0007aad8f/family1 in testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:48,022 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp, totalSize=27.1 K 2023-03-31 16:55:48,022 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting fb3d9979d8f844eda5367e1a7e7b4085, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737830 2023-03-31 16:55:48,023 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting a51e64f8916a410f9a58ced6cf063c69, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:48,023 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting abccaef6708c4d60962ab9281e3aadb1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740454 2023-03-31 16:55:48,026 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 9a6cff1f4c56431e9441119ae298cd92, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:48,027 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 5e0fc31ae1a44cb0a5b2239683a516a5, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:48,036 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 0f44b94914d47f6c0fa40cc0007aad8f#family1#compaction#201 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:48,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008] to archive 2023-03-31 16:55:48,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:48,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/81cb9d85bc0b40e6b38927c78e28b287 2023-03-31 16:55:48,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/b5a03f8ed10344ebb73ff4a059ba0e2d 2023-03-31 16:55:48,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/0970d1c8127e4b58be49b41ac5c92c17 2023-03-31 16:55:48,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/f25ab4ea2cd14b20875cd0bec2af07c2 2023-03-31 16:55:48,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family2/177a75aa4a4543b98c789a9a484a0008 2023-03-31 16:55:48,476 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del 2023-03-31 16:55:48,476 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del 2023-03-31 16:55:48,542 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76f639da58b64aec86a64047ede24189 2023-03-31 16:55:48,543 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family1/76f639da58b64aec86a64047ede24189 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/76f639da58b64aec86a64047ede24189 2023-03-31 16:55:48,570 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76f639da58b64aec86a64047ede24189 2023-03-31 16:55:48,571 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f44b94914d47f6c0fa40cc0007aad8f/family1 of 0f44b94914d47f6c0fa40cc0007aad8f into 76f639da58b64aec86a64047ede24189(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:48,571 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:48,571 DEBUG [Listener at localhost/38381] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-31 16:55:48,572 DEBUG [Listener at localhost/38381] regionserver.HStore(1912): 0f44b94914d47f6c0fa40cc0007aad8f/family2 is initiating major compaction (all files) 2023-03-31 16:55:48,572 INFO [Listener at localhost/38381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-31 16:55:48,572 INFO [Listener at localhost/38381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-31 16:55:48,573 INFO [Listener at localhost/38381] regionserver.HRegion(2259): Starting compaction of 0f44b94914d47f6c0fa40cc0007aad8f/family2 in testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:48,573 INFO [Listener at localhost/38381] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b] into tmpdir=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp, totalSize=25.4 K 2023-03-31 16:55:48,573 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 51d4c940f360441ebc1ae50e57912c4d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1680281737830 2023-03-31 16:55:48,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting b5061927ba534324932268785db4dc35, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1680281738570 2023-03-31 16:55:48,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 86c6f2ffbfec4780a7b457530c3de747, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1680281740454 2023-03-31 16:55:48,574 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 84df017b3baa414298b595df67841d40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1680281741924 2023-03-31 16:55:48,575 DEBUG [Listener at localhost/38381] compactions.Compactor(207): Compacting 89c9ce43983145a68f3b1154c9a2524b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-31 16:55:48,587 INFO [Listener at localhost/38381] throttle.PressureAwareThroughputController(145): 0f44b94914d47f6c0fa40cc0007aad8f#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-31 16:55:48,593 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230331dd52ac4fef1e4593a45c3a51c1b1ff5c_del 2023-03-31 16:55:48,594 INFO [Listener at localhost/38381] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331dd52ac4fef1e4593a45c3a51c1b1ff5c_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230331dd52ac4fef1e4593a45c3a51c1b1ff5c_del 2023-03-31 16:55:48,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5] to archive 2023-03-31 16:55:48,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:48,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/fb3d9979d8f844eda5367e1a7e7b4085 2023-03-31 16:55:48,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/a51e64f8916a410f9a58ced6cf063c69 2023-03-31 16:55:48,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/abccaef6708c4d60962ab9281e3aadb1 2023-03-31 16:55:48,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/9a6cff1f4c56431e9441119ae298cd92 2023-03-31 16:55:48,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/5e0fc31ae1a44cb0a5b2239683a516a5 2023-03-31 16:55:49,008 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c789d045a40494c8261162d27e8362b 2023-03-31 16:55:49,009 DEBUG [Listener at localhost/38381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/.tmp/family2/1c789d045a40494c8261162d27e8362b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/1c789d045a40494c8261162d27e8362b 2023-03-31 16:55:49,012 INFO [Listener at localhost/38381] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c789d045a40494c8261162d27e8362b 2023-03-31 16:55:49,013 INFO [Listener at localhost/38381] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f44b94914d47f6c0fa40cc0007aad8f/family2 of 0f44b94914d47f6c0fa40cc0007aad8f into 1c789d045a40494c8261162d27e8362b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-31 16:55:49,013 DEBUG [Listener at localhost/38381] regionserver.HRegion(2289): Compaction status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:49,017 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:49,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b] to archive 2023-03-31 16:55:49,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:49,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/51d4c940f360441ebc1ae50e57912c4d 2023-03-31 16:55:49,022 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:49,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/b5061927ba534324932268785db4dc35 2023-03-31 16:55:49,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/86c6f2ffbfec4780a7b457530c3de747 2023-03-31 16:55:49,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/84df017b3baa414298b595df67841d40 2023-03-31 16:55:49,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family2/89c9ce43983145a68f3b1154c9a2524b 2023-03-31 16:55:49,031 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:49,032 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:49,038 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46457] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x87\xE23\xF7\xE4:mF\xB6g\xE3\x09\xF3\xB8&\x9E"\x10\xC2fa.@nH\xC2\x86\x8D\xBAx\x1E\x0AI\xD7*\x10\xFBgt\x10\x14\xE9\x05\xB8\x07\x81\xE9S&9\xE0\xE62\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-31 16:55:49,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-31 16:55:49,073 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-31 16:55:49,074 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1680282349074 2023-03-31 16:55:49,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:55:49,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-31 16:55:49,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-31 16:55:49,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del 2023-03-31 16:55:49,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del 2023-03-31 16:55:49,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del 2023-03-31 16:55:49,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:49,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] zookeeper.ReadOnlyZKClient(139): Connect 0x4a0f1fa2 to 127.0.0.1:57785 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-31 16:55:49,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9284b12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-31 16:55:49,656 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:49,838 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303316464e07379c34b3a95e854cb66398845 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303316464e07379c34b3a95e854cb66398845 2023-03-31 16:55:49,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:49,850 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-31 16:55:49,853 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-31 16:55:49,865 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-31 16:55:49,868 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-31 16:55:49,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230331/family1/a117c049aa8f4a30955346161f36498c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-31 16:55:49,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230331/family1/a117c049aa8f4a30955346161f36498c}] 2023-03-31 16:55:49,921 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230331/family1/a117c049aa8f4a30955346161f36498c for inclusion in d25501d31e081f4b1fbc7283eafcd104/family1 2023-03-31 16:55:49,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-31 16:55:49,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-31 16:55:49,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:49,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230331/family1/a117c049aa8f4a30955346161f36498c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__egluvkfagd7svcv4c7u6qm6e9hjj1j6k7bsofucu8tpnq0nupjh5ku1me2oeb2hj/family1/a117c049aa8f4a30955346161f36498c 2023-03-31 16:55:49,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__egluvkfagd7svcv4c7u6qm6e9hjj1j6k7bsofucu8tpnq0nupjh5ku1me2oeb2hj/family1/a117c049aa8f4a30955346161f36498c as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/30a63fcffb504c61a5b5f0f299437ce6_SeqId_28_ 2023-03-31 16:55:49,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__egluvkfagd7svcv4c7u6qm6e9hjj1j6k7bsofucu8tpnq0nupjh5ku1me2oeb2hj/family1/a117c049aa8f4a30955346161f36498c into d25501d31e081f4b1fbc7283eafcd104/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/30a63fcffb504c61a5b5f0f299437ce6_SeqId_28_ - updating store file list. 2023-03-31 16:55:49,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/30a63fcffb504c61a5b5f0f299437ce6_SeqId_28_ into d25501d31e081f4b1fbc7283eafcd104/family1 2023-03-31 16:55:49,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__egluvkfagd7svcv4c7u6qm6e9hjj1j6k7bsofucu8tpnq0nupjh5ku1me2oeb2hj/family1/a117c049aa8f4a30955346161f36498c into d25501d31e081f4b1fbc7283eafcd104/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/family1/30a63fcffb504c61a5b5f0f299437ce6_SeqId_28_) 2023-03-31 16:55:49,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__egluvkfagd7svcv4c7u6qm6e9hjj1j6k7bsofucu8tpnq0nupjh5ku1me2oeb2hj/family1/a117c049aa8f4a30955346161f36498c 2023-03-31 16:55:49,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:49,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:49,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303314df07dd5abc744528f86e1dc2a398434 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303314df07dd5abc744528f86e1dc2a398434 2023-03-31 16:55:49,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331a151d618624047e4bd9b2a424974ba50 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331a151d618624047e4bd9b2a424974ba50 2023-03-31 16:55:49,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d8702a427d3d44139e16fd39e9ad9a6c to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d8702a427d3d44139e16fd39e9ad9a6c 2023-03-31 16:55:49,991 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d96ff17c3dd04466ab49478629cfd864 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331d96ff17c3dd04466ab49478629cfd864 2023-03-31 16:55:49,991 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-31 16:55:49,991 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230331' 2023-03-31 16:55:49,991 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:49,991 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:50,203 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230331bd2fd18730ba4b3e9ec8890d122cd956 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230331bd2fd18730ba4b3e9ec8890d122cd956 2023-03-31 16:55:50,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:50,266 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230331/family1/b84fd9cd944c4d529aa1227b95bc6e5b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-31 16:55:50,267 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230331/family1/b84fd9cd944c4d529aa1227b95bc6e5b}] 2023-03-31 16:55:50,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230331/family1/b84fd9cd944c4d529aa1227b95bc6e5b for inclusion in 0f44b94914d47f6c0fa40cc0007aad8f/family1 2023-03-31 16:55:50,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-31 16:55:50,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-31 16:55:50,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:50,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230331/family1/b84fd9cd944c4d529aa1227b95bc6e5b to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__ou3hqicr425r0k1ggq86v65cj9ogn1frofaasb6q91ig5s607tjdu3lq96t8vjjm/family1/b84fd9cd944c4d529aa1227b95bc6e5b 2023-03-31 16:55:50,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__ou3hqicr425r0k1ggq86v65cj9ogn1frofaasb6q91ig5s607tjdu3lq96t8vjjm/family1/b84fd9cd944c4d529aa1227b95bc6e5b as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/1185a82b80bf4f159f29f6d5812be60a_SeqId_28_ 2023-03-31 16:55:50,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__ou3hqicr425r0k1ggq86v65cj9ogn1frofaasb6q91ig5s607tjdu3lq96t8vjjm/family1/b84fd9cd944c4d529aa1227b95bc6e5b into 0f44b94914d47f6c0fa40cc0007aad8f/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/1185a82b80bf4f159f29f6d5812be60a_SeqId_28_ - updating store file list. 2023-03-31 16:55:50,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/1185a82b80bf4f159f29f6d5812be60a_SeqId_28_ into 0f44b94914d47f6c0fa40cc0007aad8f/family1 2023-03-31 16:55:50,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__ou3hqicr425r0k1ggq86v65cj9ogn1frofaasb6q91ig5s607tjdu3lq96t8vjjm/family1/b84fd9cd944c4d529aa1227b95bc6e5b into 0f44b94914d47f6c0fa40cc0007aad8f/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/family1/1185a82b80bf4f159f29f6d5812be60a_SeqId_28_) 2023-03-31 16:55:50,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__ou3hqicr425r0k1ggq86v65cj9ogn1frofaasb6q91ig5s607tjdu3lq96t8vjjm/family1/b84fd9cd944c4d529aa1227b95bc6e5b 2023-03-31 16:55:50,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:50,337 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:50,339 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303311f2da7e8095f4ac7b4ac25dc27323973 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303311f2da7e8095f4ac7b4ac25dc27323973 2023-03-31 16:55:50,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023033169ed3e00d0b540f19d0de8659378d567 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023033169ed3e00d0b540f19d0de8659378d567 2023-03-31 16:55:50,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303316cfda549ff5e465fa55965f9b43fcee1 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303316cfda549ff5e465fa55965f9b43fcee1 2023-03-31 16:55:50,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230331ff2b07ebad484648930273b6ad753eb9 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230331ff2b07ebad484648930273b6ad753eb9 2023-03-31 16:55:50,345 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-31 16:55:50,345 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230331' 2023-03-31 16:55:50,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:50,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:51,305 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230331d7e8bd2d6bfa406a854614b5b0e9b138 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331d7e8bd2d6bfa406a854614b5b0e9b138 2023-03-31 16:55:51,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:51,360 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230331/family1/4977165a0e13465a9fd929bd422451ed first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-31 16:55:51,361 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf., hostname=jenkins-hbase4.apache.org,41157,1680281619369, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230331/family1/4977165a0e13465a9fd929bd422451ed}] 2023-03-31 16:55:51,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(763): Validating hfile at hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230331/family1/4977165a0e13465a9fd929bd422451ed for inclusion in d7d94fd29c86b55fba635f4878101dbf/family1 2023-03-31 16:55:51,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-31 16:55:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(777): Region bounds: first= last=1 2023-03-31 16:55:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegion(2446): Flush status journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230331/family1/4977165a0e13465a9fd929bd422451ed to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__o4t6i3iavbb0vpl7nr8aab8863keqvml6bld6oiti8val0kt2r94uhq6vpbs2p3b/family1/4977165a0e13465a9fd929bd422451ed 2023-03-31 16:55:51,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__o4t6i3iavbb0vpl7nr8aab8863keqvml6bld6oiti8val0kt2r94uhq6vpbs2p3b/family1/4977165a0e13465a9fd929bd422451ed as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/a33e669aba424633bee4c919b40eccb2_SeqId_28_ 2023-03-31 16:55:51,390 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(849): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__o4t6i3iavbb0vpl7nr8aab8863keqvml6bld6oiti8val0kt2r94uhq6vpbs2p3b/family1/4977165a0e13465a9fd929bd422451ed into d7d94fd29c86b55fba635f4878101dbf/family1 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/a33e669aba424633bee4c919b40eccb2_SeqId_28_ - updating store file list. 2023-03-31 16:55:51,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(882): Loaded HFile hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/a33e669aba424633bee4c919b40eccb2_SeqId_28_ into d7d94fd29c86b55fba635f4878101dbf/family1 2023-03-31 16:55:51,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.HStore(855): Successfully loaded hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__o4t6i3iavbb0vpl7nr8aab8863keqvml6bld6oiti8val0kt2r94uhq6vpbs2p3b/family1/4977165a0e13465a9fd929bd422451ed into d7d94fd29c86b55fba635f4878101dbf/family1 (new location: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/family1/a33e669aba424633bee4c919b40eccb2_SeqId_28_) 2023-03-31 16:55:51,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41157] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/staging/jenkins__testMajorCompactionFromAdmin__o4t6i3iavbb0vpl7nr8aab8863keqvml6bld6oiti8val0kt2r94uhq6vpbs2p3b/family1/4977165a0e13465a9fd929bd422451ed 2023-03-31 16:55:51,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230331 table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:51,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:51,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303314237997e0a3a41afa441a57115749214 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303314237997e0a3a41afa441a57115749214 2023-03-31 16:55:51,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033185cef5b11069447c81f846b784fae3ff to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023033185cef5b11069447c81f846b784fae3ff 2023-03-31 16:55:51,423 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a05ee47dc16b483982353363a636fac7 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a05ee47dc16b483982353363a636fac7 2023-03-31 16:55:51,424 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331b7284d1d56094584b14ce8e56fc50cc3 to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331b7284d1d56094584b14ce8e56fc50cc3 2023-03-31 16:55:51,424 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-31 16:55:51,424 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230331' 2023-03-31 16:55:51,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230331 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:51,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-31 16:55:51,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-31 16:55:51,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del] 2023-03-31 16:55:51,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:51,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230331a0e195f18b9b468bac749596f702fb82_del 2023-03-31 16:55:51,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-31 16:55:51,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del] 2023-03-31 16:55:51,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:51,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230331ff3adee300b942fc9895106b9903ebbc_del 2023-03-31 16:55:51,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-31 16:55:51,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del] 2023-03-31 16:55:51,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(360): Archiving compacted files. 2023-03-31 16:55:51,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del to hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303317a93fd37736e46058a723c929764ce4e_del 2023-03-31 16:55:51,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-31 16:55:51,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1680281622663] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-31 16:55:51,432 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-31 16:55:51,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3610 sec 2023-03-31 16:55:51,449 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:51,451 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:51,453 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-31 16:55:51,454 DEBUG [Listener at localhost/38381] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-31 16:55:51,458 INFO [Listener at localhost/38381] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-31 16:55:51,498 INFO [Listener at localhost/38381] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 257), OpenFileDescriptor=639 (was 646), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=424 (was 418) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3632 (was 3587) - AvailableMemoryMB LEAK? - 2023-03-31 16:55:51,498 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33fc1e18 to 127.0.0.1:57785 2023-03-31 16:55:51,499 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:51,499 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-31 16:55:51,499 INFO [Listener at localhost/38381] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-31 16:55:51,499 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0672b468 to 127.0.0.1:57785 2023-03-31 16:55:51,499 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:51,500 DEBUG [Listener at localhost/38381] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-31 16:55:51,500 DEBUG [Listener at localhost/38381] util.JVMClusterUtil(257): Found active master hash=769368072, stopped=false 2023-03-31 16:55:51,500 INFO [Listener at localhost/38381] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:55:51,502 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-31 16:55:51,502 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-31 16:55:51,503 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:55:51,503 INFO [Listener at localhost/38381] procedure2.ProcedureExecutor(629): Stopping 2023-03-31 16:55:51,503 DEBUG [Listener at localhost/38381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f787e5f to 127.0.0.1:57785 2023-03-31 16:55:51,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-31 16:55:51,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-31 16:55:51,503 DEBUG [Listener at localhost/38381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:51,504 INFO [Listener at localhost/38381] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41157,1680281619369' ***** 2023-03-31 16:55:51,504 INFO [Listener at localhost/38381] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-31 16:55:51,504 INFO [RS:0;jenkins-hbase4:41157] regionserver.HeapMemoryManager(220): Stopping 2023-03-31 16:55:51,504 INFO [RS:0;jenkins-hbase4:41157] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-31 16:55:51,504 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-31 16:55:51,504 INFO [RS:0;jenkins-hbase4:41157] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 12d9b8319d30882fd5cfc267a7bc5663 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 57a0c62f5ac9e62580d0ef1c0c3118f6 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 9d75307803a2d0115061ae5c1a041c12 2023-03-31 16:55:51,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 12d9b8319d30882fd5cfc267a7bc5663, disabling compactions & flushes 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for fd69f5667dfc09dd87ddcab179927c81 2023-03-31 16:55:51,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 9e84b76b45cb4571e5ae3c513a680551 2023-03-31 16:55:51,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for ea65ff07c2e9369016f64da014f99098 2023-03-31 16:55:51,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. after waiting 0 ms 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for d25501d31e081f4b1fbc7283eafcd104 2023-03-31 16:55:51,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for d7d94fd29c86b55fba635f4878101dbf 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 7bbc72bafbb27152a2a6f4ac820714d1 2023-03-31 16:55:51,505 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 724908ac2aaaf3b89f3ceb67b0d48ee7 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 0f44b94914d47f6c0fa40cc0007aad8f 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 8a6bc2c65d66d97bc6535fe98d1f8cfc 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 538db8bff598648ee8c34bd3a6524107 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 8b42dcbfa58e1735b1bbec166cd317b5 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for b4efe581f49b013f979767b3126b9e91 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 681fb89e6933230e50dee80bd3f2107b 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 007079f1db1ff7051238b27d5352ab55 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for ac187f8886d6480a15f5aa4cdc3a4bd3 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 25a5754dee8c6c40ad6587987233065a 2023-03-31 16:55:51,506 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:51,506 DEBUG [RS:0;jenkins-hbase4:41157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3054ce79 to 127.0.0.1:57785 2023-03-31 16:55:51,506 DEBUG [RS:0;jenkins-hbase4:41157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:51,507 INFO [RS:0;jenkins-hbase4:41157] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-31 16:55:51,507 INFO [RS:0;jenkins-hbase4:41157] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-31 16:55:51,507 INFO [RS:0;jenkins-hbase4:41157] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-31 16:55:51,507 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-31 16:55:51,507 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-31 16:55:51,507 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-31 16:55:51,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-31 16:55:51,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-31 16:55:51,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-31 16:55:51,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-31 16:55:51,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-31 16:55:51,508 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1505): Waiting on 007079f1db1ff7051238b27d5352ab55, 0f44b94914d47f6c0fa40cc0007aad8f, 12d9b8319d30882fd5cfc267a7bc5663, 1588230740, 25a5754dee8c6c40ad6587987233065a, 538db8bff598648ee8c34bd3a6524107, 57a0c62f5ac9e62580d0ef1c0c3118f6, 681fb89e6933230e50dee80bd3f2107b, 724908ac2aaaf3b89f3ceb67b0d48ee7, 7bbc72bafbb27152a2a6f4ac820714d1, 8a6bc2c65d66d97bc6535fe98d1f8cfc, 8b42dcbfa58e1735b1bbec166cd317b5, 9d75307803a2d0115061ae5c1a041c12, 9e84b76b45cb4571e5ae3c513a680551, ac187f8886d6480a15f5aa4cdc3a4bd3, b4efe581f49b013f979767b3126b9e91, d25501d31e081f4b1fbc7283eafcd104, d7d94fd29c86b55fba635f4878101dbf, ea65ff07c2e9369016f64da014f99098, fd69f5667dfc09dd87ddcab179927c81, ff1868f2303cdd4ae4f9f4619364c335 2023-03-31 16:55:51,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/12d9b8319d30882fd5cfc267a7bc5663/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 12d9b8319d30882fd5cfc267a7bc5663: 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1680281711276.12d9b8319d30882fd5cfc267a7bc5663. 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 57a0c62f5ac9e62580d0ef1c0c3118f6, disabling compactions & flushes 2023-03-31 16:55:51,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. after waiting 0 ms 2023-03-31 16:55:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:55:51,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/57a0c62f5ac9e62580d0ef1c0c3118f6/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-31 16:55:51,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:55:51,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 57a0c62f5ac9e62580d0ef1c0c3118f6: 2023-03-31 16:55:51,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1680281647048.57a0c62f5ac9e62580d0ef1c0c3118f6. 2023-03-31 16:55:51,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d75307803a2d0115061ae5c1a041c12, disabling compactions & flushes 2023-03-31 16:55:51,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:51,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:51,516 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-31 16:55:51,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. after waiting 0 ms 2023-03-31 16:55:51,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:51,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithMonthlyPolicy/9d75307803a2d0115061ae5c1a041c12/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-31 16:55:51,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:51,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d75307803a2d0115061ae5c1a041c12: 2023-03-31 16:55:51,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1680281726646.9d75307803a2d0115061ae5c1a041c12. 2023-03-31 16:55:51,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd69f5667dfc09dd87ddcab179927c81, disabling compactions & flushes 2023-03-31 16:55:51,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:51,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/info/dd08f31d8ffa43f79ccaa07d0282dc96 2023-03-31 16:55:51,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:51,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. after waiting 0 ms 2023-03-31 16:55:51,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:51,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd08f31d8ffa43f79ccaa07d0282dc96 2023-03-31 16:55:51,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/fd69f5667dfc09dd87ddcab179927c81/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-31 16:55:51,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd69f5667dfc09dd87ddcab179927c81: 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1680281690179.fd69f5667dfc09dd87ddcab179927c81. 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e84b76b45cb4571e5ae3c513a680551, disabling compactions & flushes 2023-03-31 16:55:51,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. after waiting 0 ms 2023-03-31 16:55:51,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:51,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/9e84b76b45cb4571e5ae3c513a680551/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-31 16:55:51,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:51,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e84b76b45cb4571e5ae3c513a680551: 2023-03-31 16:55:51,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1680281690179.9e84b76b45cb4571e5ae3c513a680551. 2023-03-31 16:55:51,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea65ff07c2e9369016f64da014f99098, disabling compactions & flushes 2023-03-31 16:55:51,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:55:51,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:55:51,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. after waiting 0 ms 2023-03-31 16:55:51,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:55:51,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/ea65ff07c2e9369016f64da014f99098/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-31 16:55:51,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea65ff07c2e9369016f64da014f99098: 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1680281647048.ea65ff07c2e9369016f64da014f99098. 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d25501d31e081f4b1fbc7283eafcd104, disabling compactions & flushes 2023-03-31 16:55:51,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. after waiting 0 ms 2023-03-31 16:55:51,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:51,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d25501d31e081f4b1fbc7283eafcd104/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d25501d31e081f4b1fbc7283eafcd104: 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1680281735678.d25501d31e081f4b1fbc7283eafcd104. 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7d94fd29c86b55fba635f4878101dbf, disabling compactions & flushes 2023-03-31 16:55:51,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. after waiting 0 ms 2023-03-31 16:55:51,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:51,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/d7d94fd29c86b55fba635f4878101dbf/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7d94fd29c86b55fba635f4878101dbf: 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1680281735678.d7d94fd29c86b55fba635f4878101dbf. 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7bbc72bafbb27152a2a6f4ac820714d1, disabling compactions & flushes 2023-03-31 16:55:51,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. after waiting 0 ms 2023-03-31 16:55:51,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:55:51,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7bbc72bafbb27152a2a6f4ac820714d1 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-31 16:55:51,570 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-31 16:55:51,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/.tmp/info/1c7c4804e5794e31961d3bb0faa1a8d9 2023-03-31 16:55:51,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/.tmp/info/1c7c4804e5794e31961d3bb0faa1a8d9 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/info/1c7c4804e5794e31961d3bb0faa1a8d9 2023-03-31 16:55:51,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/info/1c7c4804e5794e31961d3bb0faa1a8d9, entries=3, sequenceid=7, filesize=4.8 K 2023-03-31 16:55:51,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 7bbc72bafbb27152a2a6f4ac820714d1 in 25ms, sequenceid=7, compaction requested=false 2023-03-31 16:55:51,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/namespace/7bbc72bafbb27152a2a6f4ac820714d1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-31 16:55:51,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7bbc72bafbb27152a2a6f4ac820714d1: 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1680281621635.7bbc72bafbb27152a2a6f4ac820714d1. 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 724908ac2aaaf3b89f3ceb67b0d48ee7, disabling compactions & flushes 2023-03-31 16:55:51,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. after waiting 0 ms 2023-03-31 16:55:51,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:55:51,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyPolicy/724908ac2aaaf3b89f3ceb67b0d48ee7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-31 16:55:51,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:55:51,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 724908ac2aaaf3b89f3ceb67b0d48ee7: 2023-03-31 16:55:51,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1680281651682.724908ac2aaaf3b89f3ceb67b0d48ee7. 2023-03-31 16:55:51,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f44b94914d47f6c0fa40cc0007aad8f, disabling compactions & flushes 2023-03-31 16:55:51,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:51,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:51,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. after waiting 0 ms 2023-03-31 16:55:51,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:51,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionFromAdmin/0f44b94914d47f6c0fa40cc0007aad8f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:51,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f44b94914d47f6c0fa40cc0007aad8f: 2023-03-31 16:55:51,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1680281735678.0f44b94914d47f6c0fa40cc0007aad8f. 2023-03-31 16:55:51,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a6bc2c65d66d97bc6535fe98d1f8cfc, disabling compactions & flushes 2023-03-31 16:55:51,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:55:51,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:55:51,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. after waiting 0 ms 2023-03-31 16:55:51,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:55:51,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testScannerOnBulkLoadRefHFiles/8a6bc2c65d66d97bc6535fe98d1f8cfc/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-31 16:55:51,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a6bc2c65d66d97bc6535fe98d1f8cfc: 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1680281647048.8a6bc2c65d66d97bc6535fe98d1f8cfc. 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 538db8bff598648ee8c34bd3a6524107, disabling compactions & flushes 2023-03-31 16:55:51,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. after waiting 0 ms 2023-03-31 16:55:51,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:55:51,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/538db8bff598648ee8c34bd3a6524107/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-31 16:55:51,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 538db8bff598648ee8c34bd3a6524107: 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1680281671571.538db8bff598648ee8c34bd3a6524107. 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff1868f2303cdd4ae4f9f4619364c335, disabling compactions & flushes 2023-03-31 16:55:51,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. after waiting 0 ms 2023-03-31 16:55:51,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:55:51,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/ff1868f2303cdd4ae4f9f4619364c335/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-31 16:55:51,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff1868f2303cdd4ae4f9f4619364c335: 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1680281622812.ff1868f2303cdd4ae4f9f4619364c335. 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b42dcbfa58e1735b1bbec166cd317b5, disabling compactions & flushes 2023-03-31 16:55:51,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. after waiting 0 ms 2023-03-31 16:55:51,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:55:51,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMinorCompactionWithWeeklyPolicy/8b42dcbfa58e1735b1bbec166cd317b5/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-31 16:55:51,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b42dcbfa58e1735b1bbec166cd317b5: 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1680281640456.8b42dcbfa58e1735b1bbec166cd317b5. 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b4efe581f49b013f979767b3126b9e91, disabling compactions & flushes 2023-03-31 16:55:51,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. after waiting 0 ms 2023-03-31 16:55:51,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:51,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/b4efe581f49b013f979767b3126b9e91/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:51,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b4efe581f49b013f979767b3126b9e91: 2023-03-31 16:55:51,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1680281711276.b4efe581f49b013f979767b3126b9e91. 2023-03-31 16:55:51,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 681fb89e6933230e50dee80bd3f2107b, disabling compactions & flushes 2023-03-31 16:55:51,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:51,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:51,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. after waiting 0 ms 2023-03-31 16:55:51,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/ns/testMinorCompaction/681fb89e6933230e50dee80bd3f2107b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-31 16:55:51,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 681fb89e6933230e50dee80bd3f2107b: 2023-03-31 16:55:51,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1680281711276.681fb89e6933230e50dee80bd3f2107b. 2023-03-31 16:55:51,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 007079f1db1ff7051238b27d5352ab55, disabling compactions & flushes 2023-03-31 16:55:51,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:55:51,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:55:51,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. after waiting 0 ms 2023-03-31 16:55:51,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithMonthlyPolicy/007079f1db1ff7051238b27d5352ab55/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-31 16:55:51,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 007079f1db1ff7051238b27d5352ab55: 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1680281632963.007079f1db1ff7051238b27d5352ab55. 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac187f8886d6480a15f5aa4cdc3a4bd3, disabling compactions & flushes 2023-03-31 16:55:51,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. after waiting 0 ms 2023-03-31 16:55:51,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:55:51,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/ac187f8886d6480a15f5aa4cdc3a4bd3/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-31 16:55:51,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:55:51,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac187f8886d6480a15f5aa4cdc3a4bd3: 2023-03-31 16:55:51,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1680281661218.ac187f8886d6480a15f5aa4cdc3a4bd3. 2023-03-31 16:55:51,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25a5754dee8c6c40ad6587987233065a, disabling compactions & flushes 2023-03-31 16:55:51,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:51,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:51,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. after waiting 0 ms 2023-03-31 16:55:51,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:51,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/default/testCompactionWithHFileLink/25a5754dee8c6c40ad6587987233065a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-31 16:55:51,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:51,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25a5754dee8c6c40ad6587987233065a: 2023-03-31 16:55:51,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1680281690179.25a5754dee8c6c40ad6587987233065a. 2023-03-31 16:55:51,674 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-31 16:55:51,674 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-31 16:55:51,708 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-31 16:55:51,909 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-31 16:55:51,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/rep_barrier/e93999c7bfef490f8d3b5ab5efdba240 2023-03-31 16:55:51,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e93999c7bfef490f8d3b5ab5efdba240 2023-03-31 16:55:52,109 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-31 16:55:52,309 DEBUG [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-31 16:55:52,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/table/80ca978b6efe46d2b381233630b1d606 2023-03-31 16:55:52,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80ca978b6efe46d2b381233630b1d606 2023-03-31 16:55:52,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/info/dd08f31d8ffa43f79ccaa07d0282dc96 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/info/dd08f31d8ffa43f79ccaa07d0282dc96 2023-03-31 16:55:52,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd08f31d8ffa43f79ccaa07d0282dc96 2023-03-31 16:55:52,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/info/dd08f31d8ffa43f79ccaa07d0282dc96, entries=226, sequenceid=130, filesize=37.9 K 2023-03-31 16:55:52,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/rep_barrier/e93999c7bfef490f8d3b5ab5efdba240 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/rep_barrier/e93999c7bfef490f8d3b5ab5efdba240 2023-03-31 16:55:52,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e93999c7bfef490f8d3b5ab5efdba240 2023-03-31 16:55:52,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/rep_barrier/e93999c7bfef490f8d3b5ab5efdba240, entries=1, sequenceid=130, filesize=5.0 K 2023-03-31 16:55:52,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/.tmp/table/80ca978b6efe46d2b381233630b1d606 as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/table/80ca978b6efe46d2b381233630b1d606 2023-03-31 16:55:52,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80ca978b6efe46d2b381233630b1d606 2023-03-31 16:55:52,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/table/80ca978b6efe46d2b381233630b1d606, entries=27, sequenceid=130, filesize=6.6 K 2023-03-31 16:55:52,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 897ms, sequenceid=130, compaction requested=false 2023-03-31 16:55:52,415 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-31 16:55:52,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-31 16:55:52,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-31 16:55:52,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-31 16:55:52,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-31 16:55:52,510 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41157,1680281619369; all regions closed. 2023-03-31 16:55:52,523 DEBUG [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/oldWALs 2023-03-31 16:55:52,523 INFO [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41157%2C1680281619369.meta:.meta(num 1680281621383) 2023-03-31 16:55:52,526 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/WALs/jenkins-hbase4.apache.org,41157,1680281619369/jenkins-hbase4.apache.org%2C41157%2C1680281619369.1680281620825 not finished, retry = 0 2023-03-31 16:55:52,629 DEBUG [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/oldWALs 2023-03-31 16:55:52,629 INFO [RS:0;jenkins-hbase4:41157] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41157%2C1680281619369:(num 1680281620825) 2023-03-31 16:55:52,629 DEBUG [RS:0;jenkins-hbase4:41157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:52,629 INFO [RS:0;jenkins-hbase4:41157] regionserver.LeaseManager(133): Closed leases 2023-03-31 16:55:52,631 INFO [RS:0;jenkins-hbase4:41157] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-31 16:55:52,631 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-31 16:55:52,632 INFO [RS:0;jenkins-hbase4:41157] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41157 2023-03-31 16:55:52,640 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41157,1680281619369 2023-03-31 16:55:52,640 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58eefddd rejected from java.util.concurrent.ThreadPoolExecutor@5cd17218[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,641 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-31 16:55:52,641 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7af4fed rejected from java.util.concurrent.ThreadPoolExecutor@5cd17218[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,641 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-31 16:55:52,641 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41157,1680281619369] 2023-03-31 16:55:52,642 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41157,1680281619369; numProcessing=1 2023-03-31 16:55:52,644 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41157,1680281619369 already deleted, retry=false 2023-03-31 16:55:52,644 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41157,1680281619369 expired; onlineServers=0 2023-03-31 16:55:52,644 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46457,1680281617823' ***** 2023-03-31 16:55:52,644 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-31 16:55:52,644 DEBUG [M:0;jenkins-hbase4:46457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ce6aa33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-31 16:55:52,644 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46457,1680281617823 2023-03-31 16:55:52,645 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46457,1680281617823; all regions closed. 2023-03-31 16:55:52,645 DEBUG [M:0;jenkins-hbase4:46457] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-31 16:55:52,645 DEBUG [M:0;jenkins-hbase4:46457] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-31 16:55:52,645 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-31 16:55:52,645 DEBUG [M:0;jenkins-hbase4:46457] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-31 16:55:52,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680281620514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1680281620514,5,FailOnTimeoutGroup] 2023-03-31 16:55:52,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680281620514] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1680281620514,5,FailOnTimeoutGroup] 2023-03-31 16:55:52,645 INFO [M:0;jenkins-hbase4:46457] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-31 16:55:52,645 INFO [M:0;jenkins-hbase4:46457] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-31 16:55:52,646 INFO [M:0;jenkins-hbase4:46457] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-31 16:55:52,646 DEBUG [M:0;jenkins-hbase4:46457] master.HMaster(1512): Stopping service threads 2023-03-31 16:55:52,646 INFO [M:0;jenkins-hbase4:46457] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-31 16:55:52,647 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-31 16:55:52,647 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-31 16:55:52,647 ERROR [M:0;jenkins-hbase4:46457] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-31 16:55:52,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-31 16:55:52,647 INFO [M:0;jenkins-hbase4:46457] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-31 16:55:52,648 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-31 16:55:52,650 DEBUG [M:0;jenkins-hbase4:46457] zookeeper.ZKUtil(398): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-31 16:55:52,650 WARN [M:0;jenkins-hbase4:46457] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-31 16:55:52,650 INFO [M:0;jenkins-hbase4:46457] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-31 16:55:52,650 INFO [M:0;jenkins-hbase4:46457] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-31 16:55:52,650 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-31 16:55:52,650 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:55:52,650 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:55:52,650 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-31 16:55:52,650 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:55:52,651 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.71 KB heapSize=598.88 KB 2023-03-31 16:55:52,662 INFO [M:0;jenkins-hbase4:46457] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.71 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f230243808894524928214426641d03e 2023-03-31 16:55:52,666 INFO [M:0;jenkins-hbase4:46457] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f230243808894524928214426641d03e 2023-03-31 16:55:52,667 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f230243808894524928214426641d03e as hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f230243808894524928214426641d03e 2023-03-31 16:55:52,674 INFO [M:0;jenkins-hbase4:46457] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f230243808894524928214426641d03e 2023-03-31 16:55:52,674 INFO [M:0;jenkins-hbase4:46457] regionserver.HStore(1080): Added hdfs://localhost:40089/user/jenkins/test-data/dbbe5d12-fd77-5615-1fff-58ac820daf8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f230243808894524928214426641d03e, entries=123, sequenceid=1011, filesize=33.3 K 2023-03-31 16:55:52,675 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegion(2948): Finished flush of dataSize ~512.71 KB/525015, heapSize ~598.87 KB/613240, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=1011, compaction requested=false 2023-03-31 16:55:52,676 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-31 16:55:52,676 DEBUG [M:0;jenkins-hbase4:46457] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-31 16:55:52,684 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-31 16:55:52,684 INFO [M:0;jenkins-hbase4:46457] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-31 16:55:52,685 INFO [M:0;jenkins-hbase4:46457] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46457 2023-03-31 16:55:52,692 DEBUG [M:0;jenkins-hbase4:46457] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46457,1680281617823 already deleted, retry=false 2023-03-31 16:55:52,742 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-31 16:55:52,742 INFO [RS:0;jenkins-hbase4:41157] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41157,1680281619369; zookeeper connection closed. 2023-03-31 16:55:52,743 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f16ac6a rejected from java.util.concurrent.ThreadPoolExecutor@5cd17218[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,743 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2317233b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2317233b 2023-03-31 16:55:52,743 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): regionserver:41157-0x1013b7eabf20001, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-31 16:55:52,743 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d1e05c rejected from java.util.concurrent.ThreadPoolExecutor@5cd17218[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,744 INFO [Listener at localhost/38381] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-31 16:55:52,793 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-31 16:55:52,793 INFO [M:0;jenkins-hbase4:46457] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46457,1680281617823; zookeeper connection closed. 2023-03-31 16:55:52,794 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71f23fec rejected from java.util.concurrent.ThreadPoolExecutor@276f2cb2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,794 DEBUG [Listener at localhost/38381-EventThread] zookeeper.ZKWatcher(600): master:46457-0x1013b7eabf20000, quorum=127.0.0.1:57785, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-31 16:55:52,794 ERROR [Listener at localhost/38381-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25249cc rejected from java.util.concurrent.ThreadPoolExecutor@276f2cb2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-31 16:55:52,795 WARN [Listener at localhost/38381] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-31 16:55:52,803 INFO [Listener at localhost/38381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-31 16:55:52,810 WARN [BP-2102574042-172.31.14.131-1680281614568 heartbeating to localhost/127.0.0.1:40089] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-31 16:55:52,810 WARN [BP-2102574042-172.31.14.131-1680281614568 heartbeating to localhost/127.0.0.1:40089] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2102574042-172.31.14.131-1680281614568 (Datanode Uuid d4755885-a46f-4a45-9590-4d776a17b711) service to localhost/127.0.0.1:40089 2023-03-31 16:55:52,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/dfs/data/data1/current/BP-2102574042-172.31.14.131-1680281614568] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-31 16:55:52,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c25fdb09-6266-98de-cb9d-3abf61667284/cluster_a9796b56-d172-a349-973a-94d2986e3284/dfs/data/data2/current/BP-2102574042-172.31.14.131-1680281614568] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-31 16:55:52,849 INFO [Listener at localhost/38381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-31 16:55:52,984 INFO [Listener at localhost/38381] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-31 16:55:53,093 INFO [Listener at localhost/38381] hbase.HBaseTestingUtility(1293): Minicluster is down